-- Logs begin at Thu 2022-05-19 20:30:47 UTC, end at Thu 2022-05-19 22:03:30 UTC. -- May 19 21:22:41.048506 dv-cinder-835635-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 19 21:22:41.057926 dv-cinder-835635-2-iscsi devstack@n-api.service[103208]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 19 21:22:41.063172 dv-cinder-835635-2-iscsi devstack@n-api.service[103208]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu May 19 21:22:41 2022] *** May 19 21:22:41.063172 dv-cinder-835635-2-iscsi devstack@n-api.service[103208]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 19 21:22:41.063172 dv-cinder-835635-2-iscsi devstack@n-api.service[103208]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 19 21:22:41.063172 dv-cinder-835635-2-iscsi devstack@n-api.service[103208]: nodename: dv-cinder-835635-2-iscsi May 19 21:22:41.063172 dv-cinder-835635-2-iscsi devstack@n-api.service[103208]: machine: x86_64 May 19 21:22:41.063172 dv-cinder-835635-2-iscsi devstack@n-api.service[103208]: clock source: unix May 19 21:22:41.063172 dv-cinder-835635-2-iscsi devstack@n-api.service[103208]: pcre jit disabled May 19 21:22:41.063172 dv-cinder-835635-2-iscsi devstack@n-api.service[103208]: detected number of CPU cores: 4 May 19 21:22:41.063172 dv-cinder-835635-2-iscsi devstack@n-api.service[103208]: current working directory: / May 19 21:22:41.063172 dv-cinder-835635-2-iscsi devstack@n-api.service[103208]: detected binary path: /usr/bin/uwsgi-core May 19 21:22:41.063172 dv-cinder-835635-2-iscsi devstack@n-api.service[103208]: your processes number limit is 47680 May 19 21:22:41.063172 dv-cinder-835635-2-iscsi devstack@n-api.service[103208]: your memory page size is 4096 bytes May 19 21:22:41.063172 dv-cinder-835635-2-iscsi devstack@n-api.service[103208]: detected max file descriptor number: 2048 May 19 21:22:41.063172 dv-cinder-835635-2-iscsi devstack@n-api.service[103208]: lock engine: pthread robust mutexes May 19 21:22:41.063172 dv-cinder-835635-2-iscsi devstack@n-api.service[103208]: thunder lock: enabled May 19 21:22:41.063172 dv-cinder-835635-2-iscsi devstack@n-api.service[103208]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 19 21:22:41.063172 dv-cinder-835635-2-iscsi devstack@n-api.service[103208]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 19 21:22:41.112550 dv-cinder-835635-2-iscsi devstack@n-api.service[103208]: Python main interpreter initialized at 0x55ad295c39c0 May 19 21:22:41.112550 dv-cinder-835635-2-iscsi devstack@n-api.service[103208]: python threads support enabled May 19 21:22:41.112550 dv-cinder-835635-2-iscsi devstack@n-api.service[103208]: your server socket listen backlog is limited to 100 connections May 19 21:22:41.112550 dv-cinder-835635-2-iscsi devstack@n-api.service[103208]: your mercy for graceful operations on workers is 90 seconds May 19 21:22:41.112945 dv-cinder-835635-2-iscsi devstack@n-api.service[103208]: mapped 403077 bytes (393 KB) for 2 cores May 19 21:22:41.112945 dv-cinder-835635-2-iscsi devstack@n-api.service[103208]: *** Operational MODE: preforking *** May 19 21:22:41.113176 dv-cinder-835635-2-iscsi devstack@n-api.service[103208]: *** uWSGI is running in multiple interpreter mode *** May 19 21:22:41.113176 dv-cinder-835635-2-iscsi devstack@n-api.service[103208]: spawned uWSGI master process (pid: 103208) May 19 21:22:41.113462 dv-cinder-835635-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 19 21:22:41.116746 dv-cinder-835635-2-iscsi devstack@n-api.service[103208]: spawned uWSGI worker 1 (pid: 103209, cores: 1) May 19 21:22:41.116746 dv-cinder-835635-2-iscsi devstack@n-api.service[103208]: spawned uWSGI worker 2 (pid: 103210, cores: 1) May 19 21:22:41.116746 dv-cinder-835635-2-iscsi devstack@n-api.service[103208]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 19 21:22:42.340670 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 19 21:22:42.402167 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 19 21:22:43.083606 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 19 21:22:43.083606 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: from cryptography.utils import int_from_bytes May 19 21:22:43.083943 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 19 21:22:43.083943 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: from cryptography.utils import int_from_bytes May 19 21:22:43.172499 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 19 21:22:43.172499 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: from cryptography.utils import int_from_bytes May 19 21:22:43.172768 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 19 21:22:43.172768 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: from cryptography.utils import int_from_bytes May 19 21:22:45.710433 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 19 21:22:45.711158 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 19 21:22:45.711253 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 19 21:22:45.711575 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 19 21:22:45.711826 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 19 21:22:45.712209 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.712531 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.712855 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.713163 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.713491 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.713956 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.714300 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.714622 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.714958 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.715204 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.715514 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.715879 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-835635-2-iscsi {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.716200 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.716507 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.716818 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.717136 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.717437 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.717756 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.718058 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.718594 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.719030 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.720101 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.720101 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.720101 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.720461 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.720540 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.720856 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.721177 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.721463 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.721779 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.722174 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-835635-2-iscsi {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.722515 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.722842 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.723136 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.723551 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.723880 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.724318 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.724693 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.724996 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.725410 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.725678 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.726430 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.726430 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.726869 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.726988 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.727516 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.727827 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.728141 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.728448 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.728754 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.729005 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.729309 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.729626 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.729937 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.730307 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.730561 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.730817 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.731131 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.731698 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.732471 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.732783 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.737254 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.737587 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.737910 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.738227 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.738564 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.738876 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.739204 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.739525 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.739849 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.740161 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.740479 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.740889 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.65 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.741174 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.65 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.741492 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.741838 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.742131 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.742495 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.742805 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.743194 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.743402 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.743708 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.744015 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.744332 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.744651 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.744955 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.749297 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.749716 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.750048 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.750409 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.750726 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.751063 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.751355 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.751657 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.751980 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.752283 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.752592 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.752907 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.753206 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.753512 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.753847 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.754151 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.754489 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.754783 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.755099 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.755743 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.755743 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.756107 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.756324 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.756626 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.756981 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.757342 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.761728 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.762059 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.762402 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.762801 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.763122 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.763441 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.763771 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.764077 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.764388 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.764713 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.765019 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.765323 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.765628 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.765938 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.766256 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.766560 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.766864 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.767170 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.767479 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.767813 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.768125 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.769153 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.769153 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.769153 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.769734 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.773766 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.774134 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.774538 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.774840 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.775180 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.775517 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.775877 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.776155 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.776475 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.776802 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.777154 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.777462 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.777743 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.778075 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.778470 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.778783 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.779119 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.779516 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.779816 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.780157 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.780533 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.780953 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.781300 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.781589 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.781936 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.782330 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.782615 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.782947 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.783276 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.784946 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.784946 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.785135 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 19 21:22:45.785135 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 19 21:22:45.786164 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.786164 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.786407 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 19 21:22:45.786536 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.786636 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 19 21:22:45.786730 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.786855 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 19 21:22:45.787110 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.787218 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.787315 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.787439 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.787536 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.787671 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.787816 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.787943 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.788223 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.788223 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.790849 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.790849 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.791012 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.791012 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.791224 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.791356 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.791437 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.791560 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.791653 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.791653 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.791794 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.791886 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.791966 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.792042 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-835635-2-iscsi {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.792127 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.792322 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.792621 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.792621 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.792955 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.793023 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.793154 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.793239 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.793361 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.793443 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.793520 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.793671 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.794006 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.794140 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.794807 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.794981 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.795111 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.795305 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.795452 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.795604 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.795701 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.795799 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.795933 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.796069 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.796069 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.796344 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.796492 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.796637 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.796799 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.796892 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.797000 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.797000 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.797258 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.797356 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.797455 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.797593 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.797728 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.797828 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.797919 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.798001 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.798067 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-835635-2-iscsi {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.798160 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.798257 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.798365 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.798458 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.798564 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.798655 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.798762 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.798762 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.798918 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.799004 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.799087 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.799170 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.799299 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.799439 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.799552 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.799672 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.799798 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.799934 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.800028 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.800135 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.800235 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.800326 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.800463 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.800604 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.800604 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.800783 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.800921 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.801029 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.801140 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.801220 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.801295 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.801378 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.801472 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.801584 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.801669 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.801816 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.801971 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.802073 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.802303 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.802448 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.802608 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.802746 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.802920 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.803027 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.803220 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.803305 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.803521 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.803612 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.803823 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.804062 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.804168 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.804304 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.804453 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.804621 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.804784 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.804938 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.805096 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.805230 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.805367 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.805505 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.805673 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.805838 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.805980 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.806177 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.806382 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.806642 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.806855 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.807062 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.807231 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.807369 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.807505 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.807636 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.807775 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.807930 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.808063 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.808146 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.808222 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.808324 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.808418 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.808529 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.808664 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.808835 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.808981 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.809150 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.809288 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.809606 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.65 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.809764 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.810362 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.810460 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.65 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.810684 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.810796 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.811102 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.811205 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.811420 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.811566 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.811778 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.811909 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.812064 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.812191 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.812350 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.812468 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.812663 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.812912 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.813026 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.813127 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.813305 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.813426 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.813637 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.813725 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.813953 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.814046 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.814274 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.814434 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.814587 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.814730 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.814871 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.815002 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.815177 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.815393 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.815586 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.815795 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.815988 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.816194 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.816391 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.816598 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.816794 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.816993 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.817165 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.817298 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.817431 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.817646 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.817856 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.818060 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.818300 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.818391 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.818488 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.818703 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.818826 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.818917 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.819050 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.819157 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.819259 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.819360 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.819456 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.819542 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.819619 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.819718 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.819814 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.819899 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.819988 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.820078 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.820193 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.820297 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.820450 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.820592 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.820741 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.820895 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.821033 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.821184 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.821335 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.821474 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.821612 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.821751 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.821903 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.822031 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.822224 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.822448 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.822590 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.822745 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.822885 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.823033 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.823166 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.823307 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.823538 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.823679 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.823815 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.823967 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.824160 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.824332 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.824472 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.824615 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.824754 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.824862 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.824972 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.825180 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.825370 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.825691 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.825899 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.825999 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.826221 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.826337 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.826551 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.826640 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.826857 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.826961 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.827158 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.827251 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.827460 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.827562 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.827762 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.827859 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.828061 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.828179 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.828345 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.828477 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.828739 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.828883 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.829017 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.829105 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.829251 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.829343 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.829552 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.829669 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.829870 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.829972 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.830179 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.830315 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:22:45.830508 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.830603 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.830844 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.830946 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.831138 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.831301 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.831448 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.831564 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.831750 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.831870 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.832057 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.832283 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.832378 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.832601 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.832707 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.832952 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.833044 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.833272 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.833395 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.833575 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.833672 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.833888 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.833994 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.834191 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.834335 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.834518 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.834663 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.834822 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.834971 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.835115 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.835256 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.835581 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.835722 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.835896 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.836009 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.836207 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.836355 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.836520 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.836679 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.836872 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.836999 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.837218 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.837365 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.837541 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.837678 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.837860 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.838002 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.838165 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.838332 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.838556 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.838665 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.838848 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.838939 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.839150 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.839247 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.839475 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.839575 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.839750 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.839876 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.840055 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.840196 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.840338 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.840503 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.840691 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.841009 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.841352 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.841457 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.841658 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.841795 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.841954 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.842070 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.842373 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.842522 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.842673 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.842855 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.843012 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.843169 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.843285 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.843390 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.843560 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.843679 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.843878 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.843992 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.844182 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.844313 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.844485 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.844596 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.844787 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.844968 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.845148 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.845286 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.845429 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.845547 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.845703 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.845853 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.846045 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.846177 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.846390 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.846535 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.846732 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.846897 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.847017 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.847190 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.847335 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.847503 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.847657 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.847813 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.847924 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.848123 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.848254 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.848457 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.848583 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.848746 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.849025 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.849157 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.849298 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.849420 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.850294 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.850411 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.850498 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.850594 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.850713 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.850819 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.850888 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.850953 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.851016 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.851096 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.851238 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.851361 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.851485 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.851624 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.851743 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.851824 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.851978 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.852068 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.852292 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.852459 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.852588 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.852732 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.852861 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.852989 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.853176 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.853320 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.853480 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.853621 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.853772 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.853945 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.854072 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.854194 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.854411 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.854538 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.854713 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.854813 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.855017 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.855101 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.855329 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.855459 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.855635 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.855769 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.855949 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.856081 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.856280 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.856450 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.856647 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.857318 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.857747 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.857886 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.858030 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.858149 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.858287 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.858409 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.858512 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.858718 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.858804 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.859041 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.859127 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.859390 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.859498 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.859710 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.859817 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.860024 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.860114 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.860307 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.860421 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.860656 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.860881 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.860994 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.861213 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.861362 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.861484 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.861619 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.861782 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.861947 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.862076 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.862283 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.862392 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.862621 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.862765 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.862984 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.863166 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.863322 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.863445 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.863601 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.863761 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.863857 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.863937 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.864188 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.864340 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.864466 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.864563 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.864773 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.864955 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.865103 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.865250 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.865421 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.865579 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.865775 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.865899 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.866137 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.866331 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.866485 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.866614 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.866807 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.866936 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.867115 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.867231 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.867457 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.867609 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.867749 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.867840 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.868046 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.868154 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.868360 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.868458 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.868657 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.868785 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.868977 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.869077 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.869271 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.869438 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.869598 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.869688 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.869852 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.869941 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.870176 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.870339 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.870502 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.870606 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.870818 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.870936 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.871136 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.871236 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.871457 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.871590 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.871756 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.871835 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.872180 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.872288 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.872601 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.872915 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.873178 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.873300 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.873498 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.873671 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.873825 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.873998 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.874148 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.874306 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.874464 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.874613 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.874769 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.874914 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.875057 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.875202 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.875339 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.875474 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.875587 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.875795 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.875944 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.876101 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.876207 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.876424 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.876561 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.876729 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.876817 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.877048 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.877137 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.877357 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.877459 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.877688 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.877777 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.877994 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.878086 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.878319 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.878409 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.878669 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.878781 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.879005 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.879164 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.879317 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.879456 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.879644 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.879784 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.879923 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.880120 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.880350 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.880502 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.880590 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.880658 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.880818 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.880928 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.881118 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.881204 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.881452 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.881554 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.881765 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.881924 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.882100 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.882194 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.882434 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.882580 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.882719 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.882855 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.883017 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.883148 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.883323 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.883425 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.883643 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.883746 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.883947 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.884040 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.884246 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.884340 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.884543 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.884649 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.884882 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.884984 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.885163 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.885287 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.885469 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.885646 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.885873 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.885960 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.886187 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.886425 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.886778 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.886923 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.886923 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.887191 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.887191 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.887473 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.887731 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.887869 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.887982 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.888160 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.888481 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.888608 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.888787 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.888969 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.889094 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.889331 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.889441 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.889664 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.889800 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.889987 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.890081 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.890359 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.890582 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.890715 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.890840 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.890926 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.891097 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.891224 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.891310 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.891540 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.891656 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.891891 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.892153 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.892285 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.892420 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.892590 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.892720 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.892852 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.893014 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.893144 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.893337 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.893519 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.893670 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.893800 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.893956 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.894087 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.894296 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.894389 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.894582 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.894680 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.894886 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.894973 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.895190 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.895325 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.895524 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.895618 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.895812 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.895953 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.896114 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.896317 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.896463 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.896729 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.896938 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.897042 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.897294 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.897438 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.897615 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.897751 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.897929 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.898027 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.898229 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.898333 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.898570 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.898709 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.898882 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.899078 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.899222 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.899413 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.899568 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.899756 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.899968 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.900125 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.900273 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.900410 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.900612 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.900777 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.900903 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.901036 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.901163 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.901267 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.901377 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.901574 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.901826 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.901961 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.902186 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.902373 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.902539 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.902682 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.902867 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.903103 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.903672 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.903814 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.903955 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.904298 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.904467 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.904467 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.904739 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.904900 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.905034 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.905172 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.905295 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.905427 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.905566 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.905705 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.905842 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.905988 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.906138 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.906358 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.906358 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.906590 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.906737 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.906860 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.906997 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.907134 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.907260 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.907416 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.907542 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.907656 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.907786 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.907919 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.908055 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.908438 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.908593 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.908593 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.908868 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.908964 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.909067 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.909169 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.909294 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.909476 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.909632 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.909771 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.909958 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.910094 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.910329 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.910454 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.910741 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.910845 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.911032 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.911185 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.911332 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.911432 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.911628 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.911728 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.911937 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.912085 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.912255 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.912415 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.912556 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.912694 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.913025 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.913232 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.913453 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.913599 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.913703 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.913843 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.913963 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.914043 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.914124 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.914380 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.914544 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.914679 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.914809 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.914994 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.915235 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.915377 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.915600 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.915685 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.916006 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.916175 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.916410 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.916498 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.916801 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.916950 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.917100 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.917195 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.917409 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.917542 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.917718 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.917854 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.918349 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.918468 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.918594 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.918704 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.919176 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.919176 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.919441 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.919604 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.919795 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.919949 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.920117 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.920337 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.920478 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.920783 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.920885 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.921137 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.921262 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.921401 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.921494 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.921693 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.921882 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.922014 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.922283 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.922448 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.922675 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.922820 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.922987 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.923251 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.923412 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.923571 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.923728 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.923873 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.924165 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.924315 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.924470 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.924627 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.924767 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.924912 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.925137 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.925137 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.925364 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.925364 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.925622 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.925622 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.925910 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.926051 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.926190 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.926364 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.926520 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.926682 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.926835 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.926992 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.927182 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.927325 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.927491 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.927622 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.927837 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.927935 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.928107 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.928264 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.928677 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.928819 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.929109 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.929265 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.929409 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.929564 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.929801 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.929927 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.930058 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.930207 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.930387 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.930698 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.930853 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.931017 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.931152 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.931322 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.931460 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.931611 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.931808 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.931969 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.932180 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.932289 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.932493 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.932704 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.932860 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.933103 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.933214 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.933405 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.933492 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.933720 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.933843 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.934041 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.934307 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.934662 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.935286 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.935442 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.935598 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.935778 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.935965 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.936135 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.936253 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.936433 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.936586 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.936822 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.937007 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.937376 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.937493 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.937600 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.937695 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.937695 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.938039 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.938155 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.938395 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.938490 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.938894 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.939071 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.939191 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.939319 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.939476 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.939735 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.939851 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.939972 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.940075 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.940075 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.940303 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.940394 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.940589 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.940689 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.940827 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.941165 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.941165 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.941366 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.941474 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.941592 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.941758 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.942081 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.942225 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.942444 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.942537 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.942631 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.942730 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.942975 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.943268 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.943461 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.943585 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.943720 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.943853 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.943970 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.944107 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.944438 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.944438 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.944832 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.945081 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.945231 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.945335 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.945527 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.945693 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.945800 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.945922 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.946022 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.946096 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.946175 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.946267 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.946597 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.946867 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.946969 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.947068 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.947194 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.947848 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.947945 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.948219 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.948477 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.948477 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.948687 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.948915 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.949045 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.949045 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.949188 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.949269 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.949371 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.949789 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.950032 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.950177 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.950314 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.950428 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.950518 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.950613 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.951263 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.951455 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.951584 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.951849 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.951965 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.952139 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.952258 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.952406 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.952476 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.952741 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.952953 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.953080 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.953230 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.953331 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.953708 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.953827 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.953975 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.954090 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.954191 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.954537 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.954681 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.954790 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.954867 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.955025 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.955157 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.955341 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.955446 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.955713 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.955975 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.956109 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.956223 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.956322 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.956392 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.956673 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.957017 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.957125 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.957265 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.957371 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.957530 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.957730 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.957910 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.958171 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.958171 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.958458 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.958546 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.958786 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.958946 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.959085 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.959243 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.959409 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.959534 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.959751 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.959882 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.960102 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.960281 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.960518 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.960639 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.960752 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.960920 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.961052 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.961179 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.961380 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.961606 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.961737 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.961842 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.961967 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.962089 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.962323 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.962510 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.962824 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.963038 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.963297 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.963465 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.963603 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.963785 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.963923 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.964031 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.964122 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.964249 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.964334 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.964583 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.964715 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.964857 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.965005 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.965166 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.965380 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.965554 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.965802 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.965929 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.966337 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.966701 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.966853 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.966985 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.967084 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.967321 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.967454 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.967630 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.967835 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.967931 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.968092 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.968208 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.968488 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.968711 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.968862 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.968996 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.969079 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.969309 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.969503 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.969631 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.969821 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.969958 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.970138 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.970299 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.970430 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.970565 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.970655 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.970841 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.971023 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.971138 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.971344 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.971466 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.971738 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.971917 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.972097 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.972320 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.972432 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.972564 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.972661 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.972768 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.972978 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.973129 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.973244 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.973340 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.973597 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.973846 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.973959 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.974083 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.974215 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.974467 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.974592 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.974786 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.974938 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.975088 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.975214 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.975406 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.975497 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.975712 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.975807 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.976030 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.976141 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.976335 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.976436 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.976641 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.976752 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.976951 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.977074 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.977244 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.977349 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.977573 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.977665 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.977877 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.977973 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.978208 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.978392 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.978545 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.978681 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.978835 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.978975 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.979115 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.979254 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.979392 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.979533 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.979691 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.979833 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.979976 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.980118 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.980270 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.980436 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.980623 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.980812 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.981082 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.981253 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.981545 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.981734 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.981734 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.982220 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.982558 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.982765 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.982934 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.983116 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.983251 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.983443 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.983576 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.983779 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.984004 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.984157 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.984330 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.984529 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.984628 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.984821 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.984928 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.985152 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.985249 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.985476 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.985627 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.985815 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.985918 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.986177 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.986299 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.986478 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.986599 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.986794 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.986994 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.987116 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.987317 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 19 21:22:45.987432 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.987785 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.988203 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.988545 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.988887 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.989209 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.989639 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.989994 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.990489 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.990839 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.991274 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.991598 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.991917 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.992355 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.992981 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.993432 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.993756 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.994067 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.994442 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.994915 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.995222 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.995574 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.996017 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.996358 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.996789 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.997274 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.998110 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.998592 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.999015 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.999276 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:45.999615 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.000085 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.000378 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.000876 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.001203 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.001515 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.001832 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.002160 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.002498 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.002841 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.003289 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.003597 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.003972 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.004415 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.004724 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.005073 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.005503 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.005858 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.006191 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.006655 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.006997 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.007366 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.007689 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.008346 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.008782 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.009146 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.009470 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.009801 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.010213 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.010679 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.011044 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.011470 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.011781 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.012089 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.012398 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.012873 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.013840 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.014315 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.014636 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.014989 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.015409 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.015971 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.016465 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.016888 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.017157 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.017487 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.017825 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.018291 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.018611 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.018948 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.019249 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.019712 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.020030 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.020333 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.020761 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.021077 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.021509 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.021834 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.022141 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.022472 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.022799 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.023103 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.023435 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.023891 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.024320 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.024719 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.025062 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.025481 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.025786 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.026104 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.026424 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.026870 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.027205 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.027524 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.027937 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.028303 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.029210 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.029689 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.030002 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.030331 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.030660 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.030974 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.031399 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.031741 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.032096 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.032433 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.032838 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.033610 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.033946 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.034315 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.034786 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.035121 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.035425 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.035764 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.036192 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.036516 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.036853 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.037160 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.037466 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.037892 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.038203 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.038562 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.038869 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.039174 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.039481 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.039787 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.040093 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.040399 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.040711 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.041047 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.041363 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.041681 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.042000 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.042338 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.042647 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.042954 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.043257 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.043558 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.043980 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.044857 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.045175 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.045484 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.045946 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.046285 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.046603 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.047092 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.047431 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.047876 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.048245 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.048555 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.049027 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.049341 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.049672 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.050016 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.050407 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.050559 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: INFO dbcounter [None req-8104717d-4bbc-40b2-a5d1-7737b2c0ac81 None None] Registered counter for database nova_api May 19 21:22:46.050801 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.051108 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.051440 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.051882 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.052296 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.052715 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.053000 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.053400 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.053709 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.054041 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.054383 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.054723 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.055025 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.055334 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.055644 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.055941 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.056246 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.056547 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.056969 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.057288 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.057588 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.057897 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.058183 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.058524 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.058828 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.059261 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.059915 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.060335 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.060899 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.061303 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.061731 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.062169 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.062716 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.062865 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.063346 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.063672 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.064017 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.064341 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.064850 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.065203 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.065557 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.066076 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.066461 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.066885 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.067476 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.067944 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.068422 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.068651 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.068937 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.069261 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.069708 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.070142 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.070488 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.070943 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.071263 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.071586 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.071903 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.072215 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.072543 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.072860 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.073177 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.073523 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.073846 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.074140 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.074491 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.074705 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG oslo_db.sqlalchemy.engines [None req-8104717d-4bbc-40b2-a5d1-7737b2c0ac81 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103209) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 21:22:46.074808 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.075388 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.076538 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.076938 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.077280 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.077700 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.078136 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.078473 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:22:46.078724 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 19 21:22:46.081815 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG dbcounter [-] [103209] Writer thread running {{(pid=103209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 21:22:46.139910 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.context [None req-8104717d-4bbc-40b2-a5d1-7737b2c0ac81 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),77cb089b-88b9-45a8-a0a5-397a51f9efce(cell1) {{(pid=103209) load_cells /opt/stack/nova/nova/context.py:464}} May 19 21:22:46.145686 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG oslo_concurrency.lockutils [None req-8104717d-4bbc-40b2-a5d1-7737b2c0ac81 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:22:46.147322 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG oslo_concurrency.lockutils [None req-8104717d-4bbc-40b2-a5d1-7737b2c0ac81 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:22:46.148101 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG oslo_concurrency.lockutils [None req-8104717d-4bbc-40b2-a5d1-7737b2c0ac81 None None] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:22:46.149942 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: INFO dbcounter [None req-97dbbf2f-4356-415c-bf34-daafdff13792 None None] Registered counter for database nova_api May 19 21:22:46.150152 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG oslo_concurrency.lockutils [None req-8104717d-4bbc-40b2-a5d1-7737b2c0ac81 None None] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:22:46.152318 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: INFO dbcounter [None req-8104717d-4bbc-40b2-a5d1-7737b2c0ac81 None None] Registered counter for database nova_cell0 May 19 21:22:46.156820 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: INFO dbcounter [None req-8104717d-4bbc-40b2-a5d1-7737b2c0ac81 None None] Registered counter for database nova_cell1 May 19 21:22:46.174140 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG oslo_db.sqlalchemy.engines [None req-8104717d-4bbc-40b2-a5d1-7737b2c0ac81 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103209) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 21:22:46.175171 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG oslo_db.sqlalchemy.engines [None req-8104717d-4bbc-40b2-a5d1-7737b2c0ac81 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103209) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 21:22:46.175334 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG oslo_db.sqlalchemy.engines [None req-97dbbf2f-4356-415c-bf34-daafdff13792 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103210) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 21:22:46.182199 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG dbcounter [-] [103209] Writer thread running {{(pid=103209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 21:22:46.182856 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG dbcounter [-] [103210] Writer thread running {{(pid=103210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 21:22:46.188567 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG dbcounter [-] [103209] Writer thread running {{(pid=103209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 21:22:46.250538 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.context [None req-97dbbf2f-4356-415c-bf34-daafdff13792 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),77cb089b-88b9-45a8-a0a5-397a51f9efce(cell1) {{(pid=103210) load_cells /opt/stack/nova/nova/context.py:464}} May 19 21:22:46.257060 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG oslo_concurrency.lockutils [None req-97dbbf2f-4356-415c-bf34-daafdff13792 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:22:46.258830 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG oslo_concurrency.lockutils [None req-97dbbf2f-4356-415c-bf34-daafdff13792 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:22:46.259696 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG oslo_concurrency.lockutils [None req-97dbbf2f-4356-415c-bf34-daafdff13792 None None] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:22:46.262285 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG oslo_concurrency.lockutils [None req-97dbbf2f-4356-415c-bf34-daafdff13792 None None] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:22:46.265676 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: INFO dbcounter [None req-97dbbf2f-4356-415c-bf34-daafdff13792 None None] Registered counter for database nova_cell0 May 19 21:22:46.270275 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: INFO dbcounter [None req-97dbbf2f-4356-415c-bf34-daafdff13792 None None] Registered counter for database nova_cell1 May 19 21:22:46.279440 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG oslo_db.sqlalchemy.engines [None req-97dbbf2f-4356-415c-bf34-daafdff13792 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103210) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 21:22:46.282392 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG oslo_db.sqlalchemy.engines [None req-97dbbf2f-4356-415c-bf34-daafdff13792 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103210) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 21:22:46.286713 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG dbcounter [-] [103210] Writer thread running {{(pid=103210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 21:22:46.340869 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: INFO dbcounter [None req-8104717d-4bbc-40b2-a5d1-7737b2c0ac81 None None] Registered counter for database nova_cell0 May 19 21:22:46.350592 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG oslo_db.sqlalchemy.engines [None req-8104717d-4bbc-40b2-a5d1-7737b2c0ac81 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103209) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 21:22:46.357822 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG dbcounter [-] [103209] Writer thread running {{(pid=103209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 21:22:46.451289 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG dbcounter [-] [103210] Writer thread running {{(pid=103210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 21:22:46.461005 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: INFO dbcounter [None req-97dbbf2f-4356-415c-bf34-daafdff13792 None None] Registered counter for database nova_cell0 May 19 21:22:46.471067 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG oslo_db.sqlalchemy.engines [None req-97dbbf2f-4356-415c-bf34-daafdff13792 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103210) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 21:22:46.476380 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG dbcounter [-] [103210] Writer thread running {{(pid=103210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 21:22:46.707817 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: WARNING keystonemiddleware.auth_token [None req-8104717d-4bbc-40b2-a5d1-7737b2c0ac81 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 19 21:22:46.715320 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: WARNING keystonemiddleware.auth_token [None req-8104717d-4bbc-40b2-a5d1-7737b2c0ac81 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 19 21:22:46.830400 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: WARNING keystonemiddleware.auth_token [None req-97dbbf2f-4356-415c-bf34-daafdff13792 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 19 21:22:46.838501 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: WARNING keystonemiddleware.auth_token [None req-97dbbf2f-4356-415c-bf34-daafdff13792 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 19 21:22:47.069739 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: WARNING keystonemiddleware.auth_token [None req-8104717d-4bbc-40b2-a5d1-7737b2c0ac81 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 19 21:22:47.076246 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: WARNING keystonemiddleware.auth_token [None req-8104717d-4bbc-40b2-a5d1-7737b2c0ac81 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 19 21:22:47.081727 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ad295c39c0 pid: 103209 (default app) May 19 21:22:47.083924 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi [None req-8104717d-4bbc-40b2-a5d1-7737b2c0ac81 None None] Calling method '>' {{(pid=103209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:22:47.085126 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: INFO nova.api.openstack.requestlog [None req-8104717d-4bbc-40b2-a5d1-7737b2c0ac81 None None] 10.222.0.65 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001817 May 19 21:22:47.085537 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: [pid: 103209|app: 0|req: 1/1] 10.222.0.65 () {50 vars in 788 bytes} [Thu May 19 21:22:47 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 21:22:47.210648 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: WARNING keystonemiddleware.auth_token [None req-97dbbf2f-4356-415c-bf34-daafdff13792 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 19 21:22:47.218887 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: WARNING keystonemiddleware.auth_token [None req-97dbbf2f-4356-415c-bf34-daafdff13792 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 19 21:22:47.224614 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ad295c39c0 pid: 103210 (default app) May 19 21:24:09.637154 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi [None req-8104717d-4bbc-40b2-a5d1-7737b2c0ac81 None None] Calling method '>' {{(pid=103209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:24:09.638769 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: INFO nova.api.openstack.requestlog [None req-8104717d-4bbc-40b2-a5d1-7737b2c0ac81 None None] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002069 May 19 21:24:09.639523 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: [pid: 103209|app: 0|req: 2/2] 10.222.0.65 () {54 vars in 930 bytes} [Thu May 19 21:24:09 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 21:24:09.661126 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG dbcounter [-] [103210] Writing DB stats nova_api:SELECT=3 {{(pid=103210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:09.662840 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG dbcounter [-] [103210] Writing DB stats nova_cell0:SELECT=3 {{(pid=103210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:09.664054 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG dbcounter [-] [103210] Writing DB stats nova_cell1:SELECT=3 {{(pid=103210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:09.665038 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG dbcounter [-] [103210] Writing DB stats nova_cell0:SELECT=3 {{(pid=103210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:10.101418 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi [None req-1138bd01-ecc1-40d9-9576-d30bb901723c admin admin] Calling method '>' {{(pid=103210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:24:10.134209 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: INFO nova.api.openstack.requestlog [None req-1138bd01-ecc1-40d9-9576-d30bb901723c admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.485539 May 19 21:24:10.134996 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: [pid: 103210|app: 0|req: 1/3] 10.222.0.65 () {60 vars in 1291 bytes} [Thu May 19 21:24:09 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:24:12.636063 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi [None req-8104717d-4bbc-40b2-a5d1-7737b2c0ac81 None None] Calling method '>' {{(pid=103209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:24:12.637077 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: INFO nova.api.openstack.requestlog [None req-8104717d-4bbc-40b2-a5d1-7737b2c0ac81 None None] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 May 19 21:24:12.637484 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: [pid: 103209|app: 0|req: 3/4] 10.222.0.65 () {54 vars in 930 bytes} [Thu May 19 21:24:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 21:24:12.707715 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi [None req-a9394d49-8555-4ae7-bc0e-58802745f176 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "c1", "disk": 1, "os-flavor-access:is_public": true, "vcpus": 1, "rxtx_factor": 1.0, "ram": 256, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "cirros256"}} {{(pid=103210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:24:12.726547 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 21:24:12.726547 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: warnings.warn(msg) May 19 21:24:12.761023 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: INFO nova.api.openstack.requestlog [None req-a9394d49-8555-4ae7-bc0e-58802745f176 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.116577 May 19 21:24:12.762139 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: [pid: 103210|app: 0|req: 2/5] 10.222.0.65 () {64 vars in 1282 bytes} [Thu May 19 21:24:12 2022] POST /compute/v2.1/flavors => generated 407 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 21:24:12.776115 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG dbcounter [-] [103209] Writing DB stats nova_api:SELECT=3 {{(pid=103209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:12.777099 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG dbcounter [-] [103209] Writing DB stats nova_cell1:SELECT=3 {{(pid=103209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:12.778486 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG dbcounter [-] [103209] Writing DB stats nova_cell0:SELECT=3 {{(pid=103209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:12.779978 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG dbcounter [-] [103209] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:12.996074 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi [None req-7a448613-4f5b-4d13-88b8-43ef37287ed9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:24:12.998724 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 21:24:12.998724 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: warnings.warn(msg) May 19 21:24:13.071792 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: INFO nova.api.openstack.requestlog [None req-7a448613-4f5b-4d13-88b8-43ef37287ed9 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.301463 May 19 21:24:13.072402 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: [pid: 103209|app: 0|req: 4/6] 10.222.0.65 () {64 vars in 1335 bytes} [Thu May 19 21:24:12 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 21:24:15.654365 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi [None req-a9394d49-8555-4ae7-bc0e-58802745f176 admin admin] Calling method '>' {{(pid=103210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:24:15.656103 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: INFO nova.api.openstack.requestlog [None req-a9394d49-8555-4ae7-bc0e-58802745f176 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002625 May 19 21:24:15.656791 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: [pid: 103210|app: 0|req: 3/7] 10.222.0.65 () {54 vars in 930 bytes} [Thu May 19 21:24:15 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 21:24:15.838369 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi [None req-b8304bd5-e9f1-43d4-974e-8a137850c854 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "rxtx_factor": 1.0, "id": "d1", "os-flavor-access:is_public": true, "ram": 512, "vcpus": 1, "disk": 5, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=103209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:24:15.859229 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 21:24:15.859229 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: warnings.warn(msg) May 19 21:24:15.899927 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: INFO nova.api.openstack.requestlog [None req-b8304bd5-e9f1-43d4-974e-8a137850c854 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.230568 May 19 21:24:15.901277 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: [pid: 103209|app: 0|req: 5/8] 10.222.0.65 () {64 vars in 1282 bytes} [Thu May 19 21:24:15 2022] POST /compute/v2.1/flavors => generated 404 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 21:24:15.925309 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi [None req-37a88800-c1a5-4831-aef3-db1af0f95779 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:24:15.927292 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 21:24:15.927292 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: warnings.warn(msg) May 19 21:24:15.966619 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: INFO nova.api.openstack.requestlog [None req-37a88800-c1a5-4831-aef3-db1af0f95779 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.046997 May 19 21:24:15.967367 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: [pid: 103210|app: 0|req: 4/9] 10.222.0.65 () {64 vars in 1335 bytes} [Thu May 19 21:24:15 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:24:18.522288 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi [None req-b8304bd5-e9f1-43d4-974e-8a137850c854 admin admin] Calling method '>' {{(pid=103209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:24:18.524020 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: INFO nova.api.openstack.requestlog [None req-b8304bd5-e9f1-43d4-974e-8a137850c854 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002528 May 19 21:24:18.524739 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: [pid: 103209|app: 0|req: 6/10] 10.222.0.65 () {54 vars in 930 bytes} [Thu May 19 21:24:18 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 21:24:18.617762 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi [None req-2a03717a-992b-4ef5-8804-8b5cb43aff7d admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "disk": 10, "id": "d2", "ram": 1024, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "rxtx_factor": 1.0, "name": "ds1G"}} {{(pid=103210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:24:18.640050 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: INFO nova.api.openstack.requestlog [None req-2a03717a-992b-4ef5-8804-8b5cb43aff7d admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.105786 May 19 21:24:18.640780 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: [pid: 103210|app: 0|req: 5/11] 10.222.0.65 () {64 vars in 1282 bytes} [Thu May 19 21:24:18 2022] POST /compute/v2.1/flavors => generated 404 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 21:24:18.658455 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi [None req-38635ad4-058c-4058-bbcd-58994c918059 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:24:18.690762 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: INFO nova.api.openstack.requestlog [None req-38635ad4-058c-4058-bbcd-58994c918059 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035947 May 19 21:24:18.692139 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: [pid: 103209|app: 0|req: 7/12] 10.222.0.65 () {64 vars in 1335 bytes} [Thu May 19 21:24:18 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:24:21.791989 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi [None req-2a03717a-992b-4ef5-8804-8b5cb43aff7d admin admin] Calling method '>' {{(pid=103210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:24:21.793126 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: INFO nova.api.openstack.requestlog [None req-2a03717a-992b-4ef5-8804-8b5cb43aff7d admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001497 May 19 21:24:21.793727 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: [pid: 103210|app: 0|req: 6/13] 10.222.0.65 () {54 vars in 930 bytes} [Thu May 19 21:24:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 21:24:21.864365 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi [None req-993feeb0-dad2-4e8e-8bf5-64b117795b6d admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d3", "os-flavor-access:is_public": true, "disk": 10, "vcpus": 2, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "name": "ds2G"}} {{(pid=103209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:24:21.890007 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: INFO nova.api.openstack.requestlog [None req-993feeb0-dad2-4e8e-8bf5-64b117795b6d admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.089607 May 19 21:24:21.890731 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: [pid: 103209|app: 0|req: 8/14] 10.222.0.65 () {64 vars in 1282 bytes} [Thu May 19 21:24:21 2022] POST /compute/v2.1/flavors => generated 404 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 19 21:24:21.906682 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi [None req-b49ff2fb-f3bd-486b-b810-87ebb5530e21 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:24:21.942161 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: INFO nova.api.openstack.requestlog [None req-b49ff2fb-f3bd-486b-b810-87ebb5530e21 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.042029 May 19 21:24:21.943043 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: [pid: 103210|app: 0|req: 7/15] 10.222.0.65 () {64 vars in 1335 bytes} [Thu May 19 21:24:21 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 21:24:24.709864 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi [None req-993feeb0-dad2-4e8e-8bf5-64b117795b6d admin admin] Calling method '>' {{(pid=103209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:24:24.711912 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: INFO nova.api.openstack.requestlog [None req-993feeb0-dad2-4e8e-8bf5-64b117795b6d admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003026 May 19 21:24:24.712742 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: [pid: 103209|app: 0|req: 9/16] 10.222.0.65 () {54 vars in 930 bytes} [Thu May 19 21:24:24 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 21:24:24.808272 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi [None req-def3e837-79f3-4513-a19b-14c54435abab admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "swap": 0, "ram": 4096, "rxtx_factor": 1.0, "vcpus": 4, "disk": 20, "id": "d4", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G"}} {{(pid=103210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:24:24.831097 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: INFO nova.api.openstack.requestlog [None req-def3e837-79f3-4513-a19b-14c54435abab admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.107628 May 19 21:24:24.832054 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: [pid: 103210|app: 0|req: 8/17] 10.222.0.65 () {64 vars in 1282 bytes} [Thu May 19 21:24:24 2022] POST /compute/v2.1/flavors => generated 404 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 21:24:24.849808 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi [None req-f966a145-e6aa-4c85-ae12-824211c8a2cd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:24:24.890545 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: INFO nova.api.openstack.requestlog [None req-f966a145-e6aa-4c85-ae12-824211c8a2cd admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.046724 May 19 21:24:24.902353 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: [pid: 103209|app: 0|req: 10/18] 10.222.0.65 () {64 vars in 1335 bytes} [Thu May 19 21:24:24 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:24:27.250894 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi [None req-def3e837-79f3-4513-a19b-14c54435abab admin admin] Calling method '>' {{(pid=103210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:24:27.251910 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: INFO nova.api.openstack.requestlog [None req-def3e837-79f3-4513-a19b-14c54435abab admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001572 May 19 21:24:27.252307 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: [pid: 103210|app: 0|req: 9/19] 10.222.0.65 () {54 vars in 930 bytes} [Thu May 19 21:24:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 21:24:27.314287 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi [None req-ddf65dd7-ddae-4884-a131-1e052a4322bb admin admin] Calling method '>' {{(pid=103209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:24:27.339835 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: INFO nova.api.openstack.requestlog [None req-ddf65dd7-ddae-4884-a131-1e052a4322bb admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.081149 May 19 21:24:27.346598 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: [pid: 103209|app: 0|req: 11/20] 10.222.0.65 () {60 vars in 1291 bytes} [Thu May 19 21:24:27 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:24:29.712897 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi [None req-def3e837-79f3-4513-a19b-14c54435abab admin admin] Calling method '>' {{(pid=103210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:24:29.714011 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: INFO nova.api.openstack.requestlog [None req-def3e837-79f3-4513-a19b-14c54435abab admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001658 May 19 21:24:29.714472 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: [pid: 103210|app: 0|req: 10/21] 10.222.0.65 () {54 vars in 930 bytes} [Thu May 19 21:24:29 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 21:24:29.789861 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi [None req-3b420147-8d74-4ad8-8c6d-dcf693566cc2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "1", "name": "m1.tiny", "os-flavor-access:is_public": true, "disk": 1, "rxtx_factor": 1.0, "swap": 0}} {{(pid=103209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:24:29.815249 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: INFO nova.api.openstack.requestlog [None req-3b420147-8d74-4ad8-8c6d-dcf693566cc2 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.092809 May 19 21:24:29.815910 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: [pid: 103209|app: 0|req: 12/22] 10.222.0.65 () {64 vars in 1282 bytes} [Thu May 19 21:24:29 2022] POST /compute/v2.1/flavors => generated 402 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 21:24:29.830411 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi [None req-984097cd-1a78-4197-a857-a62c88aaa20f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:24:29.865117 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: INFO nova.api.openstack.requestlog [None req-984097cd-1a78-4197-a857-a62c88aaa20f admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039418 May 19 21:24:29.865960 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: [pid: 103210|app: 0|req: 11/23] 10.222.0.65 () {64 vars in 1332 bytes} [Thu May 19 21:24:29 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:24:32.354578 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi [None req-3b420147-8d74-4ad8-8c6d-dcf693566cc2 admin admin] Calling method '>' {{(pid=103209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:24:32.355706 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: INFO nova.api.openstack.requestlog [None req-3b420147-8d74-4ad8-8c6d-dcf693566cc2 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001796 May 19 21:24:32.356177 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: [pid: 103209|app: 0|req: 13/24] 10.222.0.65 () {54 vars in 930 bytes} [Thu May 19 21:24:32 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 21:24:32.434153 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi [None req-e183db11-af24-4d98-b8f8-5f3bb78e7465 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "ram": 2048, "id": "2", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "m1.small", "swap": 0, "os-flavor-access:is_public": true, "disk": 20}} {{(pid=103210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:24:32.461024 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: INFO nova.api.openstack.requestlog [None req-e183db11-af24-4d98-b8f8-5f3bb78e7465 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.096346 May 19 21:24:32.462020 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: [pid: 103210|app: 0|req: 12/25] 10.222.0.65 () {64 vars in 1282 bytes} [Thu May 19 21:24:32 2022] POST /compute/v2.1/flavors => generated 405 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 21:24:32.479385 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi [None req-b98ec012-0f0a-4fba-8a03-ff127d417f9b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:24:32.506408 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: INFO nova.api.openstack.requestlog [None req-b98ec012-0f0a-4fba-8a03-ff127d417f9b admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031271 May 19 21:24:32.507048 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: [pid: 103209|app: 0|req: 14/26] 10.222.0.65 () {64 vars in 1332 bytes} [Thu May 19 21:24:32 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:24:35.067349 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi [None req-e183db11-af24-4d98-b8f8-5f3bb78e7465 admin admin] Calling method '>' {{(pid=103210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:24:35.068373 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: INFO nova.api.openstack.requestlog [None req-e183db11-af24-4d98-b8f8-5f3bb78e7465 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001533 May 19 21:24:35.068950 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: [pid: 103210|app: 0|req: 13/27] 10.222.0.65 () {54 vars in 930 bytes} [Thu May 19 21:24:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 21:24:35.150433 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi [None req-6c9daf21-c1a9-48cc-ac03-3f7f4e65ca2a admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "3", "name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 40, "ram": 4096, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 2}} {{(pid=103209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:24:35.175406 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: INFO nova.api.openstack.requestlog [None req-6c9daf21-c1a9-48cc-ac03-3f7f4e65ca2a admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.100406 May 19 21:24:35.176771 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: [pid: 103209|app: 0|req: 15/28] 10.222.0.65 () {64 vars in 1282 bytes} [Thu May 19 21:24:35 2022] POST /compute/v2.1/flavors => generated 406 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 19 21:24:35.190169 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi [None req-0588f22f-ab6f-49a7-9f97-c5a296ba5522 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:24:35.213470 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: INFO nova.api.openstack.requestlog [None req-0588f22f-ab6f-49a7-9f97-c5a296ba5522 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028358 May 19 21:24:35.214177 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: [pid: 103210|app: 0|req: 14/29] 10.222.0.65 () {64 vars in 1332 bytes} [Thu May 19 21:24:35 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:24:37.564306 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi [None req-6c9daf21-c1a9-48cc-ac03-3f7f4e65ca2a admin admin] Calling method '>' {{(pid=103209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:24:37.565318 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: INFO nova.api.openstack.requestlog [None req-6c9daf21-c1a9-48cc-ac03-3f7f4e65ca2a admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 May 19 21:24:37.565717 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: [pid: 103209|app: 0|req: 16/30] 10.222.0.65 () {54 vars in 930 bytes} [Thu May 19 21:24:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 21:24:37.633123 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi [None req-6b08b7cd-6838-4e93-8d00-f55b08caf203 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 8192, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 80, "name": "m1.large", "vcpus": 4, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "4"}} {{(pid=103210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:24:37.653013 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: INFO nova.api.openstack.requestlog [None req-6b08b7cd-6838-4e93-8d00-f55b08caf203 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.081167 May 19 21:24:37.653667 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: [pid: 103210|app: 0|req: 15/31] 10.222.0.65 () {64 vars in 1282 bytes} [Thu May 19 21:24:37 2022] POST /compute/v2.1/flavors => generated 405 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 21:24:37.666056 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi [None req-36e37c3f-9c03-4d69-bd03-40eb9621b9f5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:24:37.693986 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: INFO nova.api.openstack.requestlog [None req-36e37c3f-9c03-4d69-bd03-40eb9621b9f5 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032025 May 19 21:24:37.697329 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: [pid: 103209|app: 0|req: 17/32] 10.222.0.65 () {64 vars in 1332 bytes} [Thu May 19 21:24:37 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:24:40.059547 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi [None req-6b08b7cd-6838-4e93-8d00-f55b08caf203 admin admin] Calling method '>' {{(pid=103210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:24:40.060852 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: INFO nova.api.openstack.requestlog [None req-6b08b7cd-6838-4e93-8d00-f55b08caf203 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001775 May 19 21:24:40.061478 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: [pid: 103210|app: 0|req: 16/33] 10.222.0.65 () {54 vars in 930 bytes} [Thu May 19 21:24:40 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 21:24:40.131409 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi [None req-2ebcce09-9775-4738-ac18-dc8f3d712aae admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 16384, "rxtx_factor": 1.0, "vcpus": 8, "os-flavor-access:is_public": true, "name": "m1.xlarge", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "5", "disk": 160}} {{(pid=103209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:24:40.158856 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: INFO nova.api.openstack.requestlog [None req-2ebcce09-9775-4738-ac18-dc8f3d712aae admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.090555 May 19 21:24:40.166928 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: [pid: 103209|app: 0|req: 18/34] 10.222.0.65 () {64 vars in 1282 bytes} [Thu May 19 21:24:40 2022] POST /compute/v2.1/flavors => generated 408 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 21:24:40.173808 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi [None req-2ffd628c-7b9c-40b2-b8a4-626c796809fc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:24:40.181174 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG dbcounter [-] [103210] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:24:40.208830 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: INFO nova.api.openstack.requestlog [None req-2ffd628c-7b9c-40b2-b8a4-626c796809fc admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040443 May 19 21:24:40.210049 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: [pid: 103210|app: 0|req: 17/35] 10.222.0.65 () {64 vars in 1332 bytes} [Thu May 19 21:24:40 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 21:25:05.066819 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi [None req-2ebcce09-9775-4738-ac18-dc8f3d712aae admin admin] Calling method '>' {{(pid=103209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:25:05.067829 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: INFO nova.api.openstack.requestlog [None req-2ebcce09-9775-4738-ac18-dc8f3d712aae admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001522 May 19 21:25:05.068201 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: [pid: 103209|app: 0|req: 19/36] 10.222.0.65 () {54 vars in 930 bytes} [Thu May 19 21:25:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 21:25:05.081938 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG dbcounter [-] [103210] Writing DB stats nova_api:SELECT=5,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=103210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:05.140048 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi [None req-94751d97-82b0-436a-b82b-c48d86b2a0cf admin admin] Calling method '>' {{(pid=103210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:25:05.160525 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: INFO nova.api.openstack.requestlog [None req-94751d97-82b0-436a-b82b-c48d86b2a0cf admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.084357 May 19 21:25:05.160525 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: [pid: 103210|app: 0|req: 18/37] 10.222.0.65 () {60 vars in 1291 bytes} [Thu May 19 21:25:05 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:25:06.229944 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi [None req-2ebcce09-9775-4738-ac18-dc8f3d712aae admin admin] Calling method '>' {{(pid=103209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:25:06.230996 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: INFO nova.api.openstack.requestlog [None req-2ebcce09-9775-4738-ac18-dc8f3d712aae admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001512 May 19 21:25:06.231445 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: [pid: 103209|app: 0|req: 20/38] 10.222.0.65 () {56 vars in 1074 bytes} [Thu May 19 21:25:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 21:25:06.432939 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi [None req-f6fc04ce-ac0b-4bfa-bc80-d57b4b822895 admin admin] Calling method '>' {{(pid=103210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:25:06.439850 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: INFO nova.api.openstack.wsgi [None req-f6fc04ce-ac0b-4bfa-bc80-d57b4b822895 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 19 21:25:06.443202 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi [None req-f6fc04ce-ac0b-4bfa-bc80-d57b4b822895 admin admin] Request method failure captured: May 19 21:25:06.443202 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 19 21:25:06.443202 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: Accept: application/json May 19 21:25:06.443202 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: Accept-Encoding: gzip, deflate May 19 21:25:06.443202 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: Connection: keep-alive May 19 21:25:06.443202 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: Content-Length: 0 May 19 21:25:06.443202 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: Host: 10.222.0.65 May 19 21:25:06.443202 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: Openstack-Api-Version: compute 2.90 May 19 21:25:06.443202 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: Openstack-System-Scope: None May 19 21:25:06.443202 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: User-Agent: python-novaclient May 19 21:25:06.443202 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: X-Auth-Token: gAAAAABihrWyRxsWE7w0mIZ0c3hVKzhibgTxoF922x1TK0gnt1JA19ThK2P5iFVdaXL_ZI0BUdUyi2sTtuxRh6X_nRrJvkHlmmAa9TU3QjF_td7KGz30gj4UM4l8rihsv40iXsy9QY-um0u4KzBqpRz6aXCRMwOHSgEKVs5yp7ji-E4RgHzOLUs May 19 21:25:06.443202 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: X-Domain-Id: None May 19 21:25:06.443202 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: X-Domain-Name: None May 19 21:25:06.443202 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: X-Identity-Status: Confirmed May 19 21:25:06.443202 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: X-Is-Admin-Project: True May 19 21:25:06.443202 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: X-Openstack-Nova-Api-Version: 2.90 May 19 21:25:06.443202 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: X-Project-Domain-Id: default May 19 21:25:06.443202 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: X-Project-Domain-Name: Default May 19 21:25:06.443202 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: X-Project-Id: 0436212ebbfa4ccb91d5457faaa851ee May 19 21:25:06.443202 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: X-Project-Name: admin May 19 21:25:06.443202 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: X-Role: reader,admin,member May 19 21:25:06.443202 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: X-Roles: reader,admin,member May 19 21:25:06.445283 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/0436212ebbfa4ccb91d5457faaa851ee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0436212ebbfa4ccb91d5457faaa851ee"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_0436212ebbfa4ccb91d5457faaa851ee"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0436212ebbfa4ccb91d5457faaa851ee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}] May 19 21:25:06.445283 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: X-Tenant: admin May 19 21:25:06.445283 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: X-Tenant-Id: 0436212ebbfa4ccb91d5457faaa851ee May 19 21:25:06.445283 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: X-Tenant-Name: admin May 19 21:25:06.445283 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: X-User: admin May 19 21:25:06.445283 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: X-User-Domain-Id: default May 19 21:25:06.445283 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: X-User-Domain-Name: Default May 19 21:25:06.445283 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: X-User-Id: d45bbb3805754099870efea6f5d53dfe May 19 21:25:06.445283 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: X-User-Name: admin May 19 21:25:06.445283 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: method: > May 19 21:25:06.445283 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: exception: Flavor 42 could not be found. May 19 21:25:06.445283 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: action_args: {'id': '42'} May 19 21:25:06.445283 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: {{(pid=103210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 21:25:06.445283 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:25:06.446531 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 19 21:25:06.446531 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 19 21:25:06.446531 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 19 21:25:06.446531 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 19 21:25:06.446531 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 19 21:25:06.446531 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 19 21:25:06.446531 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 19 21:25:06.446531 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 19 21:25:06.446531 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 19 21:25:06.446531 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 21:25:06.446531 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 19 21:25:06.446531 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 19 21:25:06.446531 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 19 21:25:06.446531 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi May 19 21:25:06.446531 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 21:25:06.446531 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi May 19 21:25:06.446531 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:25:06.446531 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 21:25:06.446531 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 21:25:06.447884 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 21:25:06.447884 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 21:25:06.447884 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 21:25:06.447884 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 21:25:06.447884 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 19 21:25:06.447884 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 19 21:25:06.447884 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 19 21:25:06.447884 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi May 19 21:25:06.447884 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 21:25:06.447884 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi May 19 21:25:06.447884 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:25:06.447884 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 21:25:06.447884 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 21:25:06.447884 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 21:25:06.447884 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 21:25:06.447884 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 19 21:25:06.447884 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi May 19 21:25:06.447884 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi [None req-f6fc04ce-ac0b-4bfa-bc80-d57b4b822895 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 21:25:06.448983 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: INFO nova.api.openstack.requestlog [None req-f6fc04ce-ac0b-4bfa-bc80-d57b4b822895 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.072536 May 19 21:25:06.448983 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: [pid: 103210|app: 0|req: 19/39] 10.222.0.65 () {60 vars in 1190 bytes} [Thu May 19 21:25:06 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 19 21:25:06.454845 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi [None req-aa9ed363-0337-4a59-ab2e-6d823dd41b02 admin admin] Calling method '>' {{(pid=103209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:25:06.458266 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG dbcounter [-] [103209] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:25:06.479413 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: INFO nova.api.openstack.requestlog [None req-aa9ed363-0337-4a59-ab2e-6d823dd41b02 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028285 May 19 21:25:06.479998 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: [pid: 103209|app: 0|req: 21/40] 10.222.0.65 () {60 vars in 1210 bytes} [Thu May 19 21:25:06 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:25:06.491575 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi [None req-3ca90e84-7db9-408f-943e-0e037538f3de admin admin] Calling method '>' {{(pid=103210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:25:06.515562 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: INFO nova.api.openstack.requestlog [None req-3ca90e84-7db9-408f-943e-0e037538f3de admin admin] 10.222.0.65 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027760 May 19 21:25:06.516131 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: [pid: 103210|app: 0|req: 20/41] 10.222.0.65 () {60 vars in 1210 bytes} [Thu May 19 21:25:06 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:25:06.526430 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi [None req-13b3e05f-5892-4bf5-afe6-b2c9b7b02463 admin admin] Calling method '>' {{(pid=103209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:25:06.533049 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: INFO nova.api.openstack.wsgi [None req-13b3e05f-5892-4bf5-afe6-b2c9b7b02463 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 19 21:25:06.536419 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi [None req-13b3e05f-5892-4bf5-afe6-b2c9b7b02463 admin admin] Request method failure captured: May 19 21:25:06.536419 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 19 21:25:06.536419 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: Accept: application/json May 19 21:25:06.536419 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: Accept-Encoding: gzip, deflate May 19 21:25:06.536419 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: Connection: keep-alive May 19 21:25:06.536419 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: Content-Length: 0 May 19 21:25:06.536419 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: Host: 10.222.0.65 May 19 21:25:06.536419 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: Openstack-Api-Version: compute 2.90 May 19 21:25:06.536419 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: Openstack-System-Scope: None May 19 21:25:06.536419 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: User-Agent: python-novaclient May 19 21:25:06.536419 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: X-Auth-Token: gAAAAABihrWyRxsWE7w0mIZ0c3hVKzhibgTxoF922x1TK0gnt1JA19ThK2P5iFVdaXL_ZI0BUdUyi2sTtuxRh6X_nRrJvkHlmmAa9TU3QjF_td7KGz30gj4UM4l8rihsv40iXsy9QY-um0u4KzBqpRz6aXCRMwOHSgEKVs5yp7ji-E4RgHzOLUs May 19 21:25:06.536419 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: X-Domain-Id: None May 19 21:25:06.536419 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: X-Domain-Name: None May 19 21:25:06.536419 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: X-Identity-Status: Confirmed May 19 21:25:06.536419 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: X-Is-Admin-Project: True May 19 21:25:06.536419 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: X-Openstack-Nova-Api-Version: 2.90 May 19 21:25:06.536419 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: X-Project-Domain-Id: default May 19 21:25:06.536419 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: X-Project-Domain-Name: Default May 19 21:25:06.536419 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: X-Project-Id: 0436212ebbfa4ccb91d5457faaa851ee May 19 21:25:06.536419 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: X-Project-Name: admin May 19 21:25:06.536419 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: X-Role: reader,admin,member May 19 21:25:06.536419 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: X-Roles: reader,admin,member May 19 21:25:06.537761 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/0436212ebbfa4ccb91d5457faaa851ee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0436212ebbfa4ccb91d5457faaa851ee"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_0436212ebbfa4ccb91d5457faaa851ee"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0436212ebbfa4ccb91d5457faaa851ee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}] May 19 21:25:06.537761 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: X-Tenant: admin May 19 21:25:06.537761 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: X-Tenant-Id: 0436212ebbfa4ccb91d5457faaa851ee May 19 21:25:06.537761 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: X-Tenant-Name: admin May 19 21:25:06.537761 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: X-User: admin May 19 21:25:06.537761 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: X-User-Domain-Id: default May 19 21:25:06.537761 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: X-User-Domain-Name: Default May 19 21:25:06.537761 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: X-User-Id: d45bbb3805754099870efea6f5d53dfe May 19 21:25:06.537761 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: X-User-Name: admin May 19 21:25:06.537761 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: method: > May 19 21:25:06.537761 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: exception: Flavor 42 could not be found. May 19 21:25:06.537761 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: action_args: {'id': '42'} May 19 21:25:06.537761 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: {{(pid=103209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 21:25:06.537761 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:25:06.538681 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 19 21:25:06.538681 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 19 21:25:06.538681 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 19 21:25:06.538681 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 19 21:25:06.538681 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 19 21:25:06.538681 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 19 21:25:06.538681 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 19 21:25:06.538681 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 19 21:25:06.538681 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 19 21:25:06.538681 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 21:25:06.538681 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 19 21:25:06.538681 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 19 21:25:06.538681 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 19 21:25:06.538681 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi May 19 21:25:06.538681 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 21:25:06.538681 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi May 19 21:25:06.538681 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:25:06.538681 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 21:25:06.538681 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 21:25:06.540103 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 21:25:06.540103 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 21:25:06.540103 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 21:25:06.540103 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 21:25:06.540103 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 19 21:25:06.540103 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 19 21:25:06.540103 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 19 21:25:06.540103 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi May 19 21:25:06.540103 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 21:25:06.540103 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi May 19 21:25:06.540103 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:25:06.540103 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 21:25:06.540103 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 21:25:06.540103 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 21:25:06.540103 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 21:25:06.540103 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 19 21:25:06.540103 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi May 19 21:25:06.540103 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi [None req-13b3e05f-5892-4bf5-afe6-b2c9b7b02463 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 21:25:06.541395 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: INFO nova.api.openstack.requestlog [None req-13b3e05f-5892-4bf5-afe6-b2c9b7b02463 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015307 May 19 21:25:06.541395 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: [pid: 103209|app: 0|req: 22/42] 10.222.0.65 () {60 vars in 1190 bytes} [Thu May 19 21:25:06 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 19 21:25:07.458974 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi [None req-3ca90e84-7db9-408f-943e-0e037538f3de admin admin] Calling method '>' {{(pid=103210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:25:07.459993 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: INFO nova.api.openstack.requestlog [None req-3ca90e84-7db9-408f-943e-0e037538f3de admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001521 May 19 21:25:07.460384 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: [pid: 103210|app: 0|req: 21/43] 10.222.0.65 () {56 vars in 1074 bytes} [Thu May 19 21:25:07 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 21:25:07.671703 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi [None req-08ccccd5-9ed2-42d0-9238-e325ae3c293e admin admin] Calling method '>' {{(pid=103209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:25:07.677480 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: INFO nova.api.openstack.wsgi [None req-08ccccd5-9ed2-42d0-9238-e325ae3c293e admin admin] HTTP exception thrown: Flavor 84 could not be found. May 19 21:25:07.679811 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi [None req-08ccccd5-9ed2-42d0-9238-e325ae3c293e admin admin] Request method failure captured: May 19 21:25:07.679811 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 19 21:25:07.679811 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: Accept: application/json May 19 21:25:07.679811 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: Accept-Encoding: gzip, deflate May 19 21:25:07.679811 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: Connection: keep-alive May 19 21:25:07.679811 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: Content-Length: 0 May 19 21:25:07.679811 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: Host: 10.222.0.65 May 19 21:25:07.679811 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: Openstack-Api-Version: compute 2.90 May 19 21:25:07.679811 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: Openstack-System-Scope: None May 19 21:25:07.679811 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: User-Agent: python-novaclient May 19 21:25:07.679811 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: X-Auth-Token: gAAAAABihrWz1xZ_yJkbB_2bAUxyuIgWyn-VAsBatXyZc-LyDO7vQuEuuHJhZr4rgT7yMEe3TIPVG09FuTBcGPirDxduNTUMEauIzBWyM1oGRtjI5KqH-qt3ScbxL2dlnv6Ffw2_2MFkj45JhLqap93e87bs8BbDD2dzfc05ykCcZ-QFlesFfYI May 19 21:25:07.679811 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: X-Domain-Id: None May 19 21:25:07.679811 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: X-Domain-Name: None May 19 21:25:07.679811 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: X-Identity-Status: Confirmed May 19 21:25:07.679811 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: X-Is-Admin-Project: True May 19 21:25:07.679811 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: X-Openstack-Nova-Api-Version: 2.90 May 19 21:25:07.679811 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: X-Project-Domain-Id: default May 19 21:25:07.679811 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: X-Project-Domain-Name: Default May 19 21:25:07.679811 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: X-Project-Id: 0436212ebbfa4ccb91d5457faaa851ee May 19 21:25:07.679811 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: X-Project-Name: admin May 19 21:25:07.679811 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: X-Role: reader,admin,member May 19 21:25:07.679811 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: X-Roles: reader,admin,member May 19 21:25:07.681303 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/0436212ebbfa4ccb91d5457faaa851ee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0436212ebbfa4ccb91d5457faaa851ee"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_0436212ebbfa4ccb91d5457faaa851ee"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0436212ebbfa4ccb91d5457faaa851ee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}] May 19 21:25:07.681303 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: X-Tenant: admin May 19 21:25:07.681303 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: X-Tenant-Id: 0436212ebbfa4ccb91d5457faaa851ee May 19 21:25:07.681303 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: X-Tenant-Name: admin May 19 21:25:07.681303 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: X-User: admin May 19 21:25:07.681303 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: X-User-Domain-Id: default May 19 21:25:07.681303 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: X-User-Domain-Name: Default May 19 21:25:07.681303 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: X-User-Id: d45bbb3805754099870efea6f5d53dfe May 19 21:25:07.681303 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: X-User-Name: admin May 19 21:25:07.681303 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: method: > May 19 21:25:07.681303 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: exception: Flavor 84 could not be found. May 19 21:25:07.681303 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: action_args: {'id': '84'} May 19 21:25:07.681303 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: {{(pid=103209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 21:25:07.681303 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:25:07.682223 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 19 21:25:07.682223 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 19 21:25:07.682223 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 19 21:25:07.682223 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 19 21:25:07.682223 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 19 21:25:07.682223 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 19 21:25:07.682223 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 19 21:25:07.682223 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 19 21:25:07.682223 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 19 21:25:07.682223 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 21:25:07.682223 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 19 21:25:07.682223 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 19 21:25:07.682223 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 19 21:25:07.682223 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi May 19 21:25:07.682223 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 21:25:07.682223 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi May 19 21:25:07.682223 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:25:07.682223 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 21:25:07.682223 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 21:25:07.683416 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 21:25:07.683416 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 21:25:07.683416 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 21:25:07.683416 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 21:25:07.683416 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 19 21:25:07.683416 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 19 21:25:07.683416 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 19 21:25:07.683416 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi May 19 21:25:07.683416 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 21:25:07.683416 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi May 19 21:25:07.683416 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:25:07.683416 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 21:25:07.683416 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 21:25:07.683416 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 21:25:07.683416 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 21:25:07.683416 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 19 21:25:07.683416 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi May 19 21:25:07.683416 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi [None req-08ccccd5-9ed2-42d0-9238-e325ae3c293e admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 21:25:07.684646 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: INFO nova.api.openstack.requestlog [None req-08ccccd5-9ed2-42d0-9238-e325ae3c293e admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.070286 May 19 21:25:07.684646 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: [pid: 103209|app: 0|req: 23/44] 10.222.0.65 () {60 vars in 1190 bytes} [Thu May 19 21:25:07 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 19 21:25:07.694688 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi [None req-c747807e-65ac-4d0f-8cbc-950388411a4b admin admin] Calling method '>' {{(pid=103210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:25:07.729540 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: INFO nova.api.openstack.requestlog [None req-c747807e-65ac-4d0f-8cbc-950388411a4b admin admin] 10.222.0.65 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.038399 May 19 21:25:07.733419 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: [pid: 103210|app: 0|req: 22/45] 10.222.0.65 () {60 vars in 1210 bytes} [Thu May 19 21:25:07 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:25:07.745117 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi [None req-f5e1bc67-054f-4a4d-86d4-c22035eadc8e admin admin] Calling method '>' {{(pid=103209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:25:07.765694 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: INFO nova.api.openstack.requestlog [None req-f5e1bc67-054f-4a4d-86d4-c22035eadc8e admin admin] 10.222.0.65 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025493 May 19 21:25:07.766790 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: [pid: 103209|app: 0|req: 24/46] 10.222.0.65 () {60 vars in 1210 bytes} [Thu May 19 21:25:07 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:25:07.781857 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi [None req-94bbf3f3-1315-4277-a31e-29d6371ee710 admin admin] Calling method '>' {{(pid=103210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:25:07.791862 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: INFO nova.api.openstack.wsgi [None req-94bbf3f3-1315-4277-a31e-29d6371ee710 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 19 21:25:07.796817 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi [None req-94bbf3f3-1315-4277-a31e-29d6371ee710 admin admin] Request method failure captured: May 19 21:25:07.796817 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 19 21:25:07.796817 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: Accept: application/json May 19 21:25:07.796817 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: Accept-Encoding: gzip, deflate May 19 21:25:07.796817 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: Connection: keep-alive May 19 21:25:07.796817 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: Content-Length: 0 May 19 21:25:07.796817 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: Host: 10.222.0.65 May 19 21:25:07.796817 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: Openstack-Api-Version: compute 2.90 May 19 21:25:07.796817 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: Openstack-System-Scope: None May 19 21:25:07.796817 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: User-Agent: python-novaclient May 19 21:25:07.796817 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: X-Auth-Token: gAAAAABihrWz1xZ_yJkbB_2bAUxyuIgWyn-VAsBatXyZc-LyDO7vQuEuuHJhZr4rgT7yMEe3TIPVG09FuTBcGPirDxduNTUMEauIzBWyM1oGRtjI5KqH-qt3ScbxL2dlnv6Ffw2_2MFkj45JhLqap93e87bs8BbDD2dzfc05ykCcZ-QFlesFfYI May 19 21:25:07.796817 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: X-Domain-Id: None May 19 21:25:07.796817 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: X-Domain-Name: None May 19 21:25:07.796817 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: X-Identity-Status: Confirmed May 19 21:25:07.796817 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: X-Is-Admin-Project: True May 19 21:25:07.796817 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: X-Openstack-Nova-Api-Version: 2.90 May 19 21:25:07.796817 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: X-Project-Domain-Id: default May 19 21:25:07.796817 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: X-Project-Domain-Name: Default May 19 21:25:07.796817 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: X-Project-Id: 0436212ebbfa4ccb91d5457faaa851ee May 19 21:25:07.796817 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: X-Project-Name: admin May 19 21:25:07.796817 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: X-Role: reader,admin,member May 19 21:25:07.796817 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: X-Roles: reader,admin,member May 19 21:25:07.798570 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/0436212ebbfa4ccb91d5457faaa851ee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0436212ebbfa4ccb91d5457faaa851ee"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_0436212ebbfa4ccb91d5457faaa851ee"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0436212ebbfa4ccb91d5457faaa851ee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}] May 19 21:25:07.798570 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: X-Tenant: admin May 19 21:25:07.798570 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: X-Tenant-Id: 0436212ebbfa4ccb91d5457faaa851ee May 19 21:25:07.798570 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: X-Tenant-Name: admin May 19 21:25:07.798570 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: X-User: admin May 19 21:25:07.798570 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: X-User-Domain-Id: default May 19 21:25:07.798570 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: X-User-Domain-Name: Default May 19 21:25:07.798570 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: X-User-Id: d45bbb3805754099870efea6f5d53dfe May 19 21:25:07.798570 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: X-User-Name: admin May 19 21:25:07.798570 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: method: > May 19 21:25:07.798570 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: exception: Flavor 84 could not be found. May 19 21:25:07.798570 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: action_args: {'id': '84'} May 19 21:25:07.798570 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: {{(pid=103210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 21:25:07.798570 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:25:07.799625 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 19 21:25:07.799625 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 19 21:25:07.799625 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 19 21:25:07.799625 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 19 21:25:07.799625 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 19 21:25:07.799625 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 19 21:25:07.799625 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 19 21:25:07.799625 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 19 21:25:07.799625 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 19 21:25:07.799625 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 21:25:07.799625 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 19 21:25:07.799625 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 19 21:25:07.799625 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 19 21:25:07.799625 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi May 19 21:25:07.799625 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 21:25:07.799625 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi May 19 21:25:07.799625 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:25:07.799625 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 21:25:07.799625 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 21:25:07.800927 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 21:25:07.800927 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 21:25:07.800927 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 21:25:07.800927 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 21:25:07.800927 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 19 21:25:07.800927 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 19 21:25:07.800927 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 19 21:25:07.800927 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi May 19 21:25:07.800927 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 21:25:07.800927 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi May 19 21:25:07.800927 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:25:07.800927 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 21:25:07.800927 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 21:25:07.800927 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 21:25:07.800927 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 21:25:07.800927 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 19 21:25:07.800927 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi May 19 21:25:07.804130 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi [None req-94bbf3f3-1315-4277-a31e-29d6371ee710 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 21:25:07.805188 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: INFO nova.api.openstack.requestlog [None req-94bbf3f3-1315-4277-a31e-29d6371ee710 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.030100 May 19 21:25:07.805861 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: [pid: 103210|app: 0|req: 23/47] 10.222.0.65 () {60 vars in 1190 bytes} [Thu May 19 21:25:07 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 19 21:25:08.736265 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi [None req-f5e1bc67-054f-4a4d-86d4-c22035eadc8e admin admin] Calling method '>' {{(pid=103209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:25:08.737309 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: INFO nova.api.openstack.requestlog [None req-f5e1bc67-054f-4a4d-86d4-c22035eadc8e admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 May 19 21:25:08.737691 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: [pid: 103209|app: 0|req: 25/48] 10.222.0.65 () {56 vars in 1074 bytes} [Thu May 19 21:25:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 21:25:08.956018 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi [None req-9cdacf00-b82a-484d-8f86-628ee90d995e admin admin] Calling method '>' {{(pid=103210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:25:08.962636 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: INFO nova.api.openstack.wsgi [None req-9cdacf00-b82a-484d-8f86-628ee90d995e admin admin] HTTP exception thrown: Flavor 451 could not be found. May 19 21:25:08.964183 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi [None req-9cdacf00-b82a-484d-8f86-628ee90d995e admin admin] Request method failure captured: May 19 21:25:08.964183 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 19 21:25:08.964183 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: Accept: application/json May 19 21:25:08.964183 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: Accept-Encoding: gzip, deflate May 19 21:25:08.964183 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: Connection: keep-alive May 19 21:25:08.964183 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: Content-Length: 0 May 19 21:25:08.964183 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: Host: 10.222.0.65 May 19 21:25:08.964183 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: Openstack-Api-Version: compute 2.90 May 19 21:25:08.964183 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: Openstack-System-Scope: None May 19 21:25:08.964183 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: User-Agent: python-novaclient May 19 21:25:08.964183 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: X-Auth-Token: gAAAAABihrW0RiZ_K7BETlzEFTyYXyTb-89vGVP87H43qOuEvYUyXOZB-Bm5Lzfk-YS0DHVmZe4ncyle_R8u8cQzgktbCNG_n6Hm4WtyusjNQ8PJeZiA8yVLhhkEf0ZiQ-RPu_-hztHhYOdXLdXCZHQWSAKZFxTH9xidhppEL71bR6M2EvupCYQ May 19 21:25:08.964183 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: X-Domain-Id: None May 19 21:25:08.964183 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: X-Domain-Name: None May 19 21:25:08.964183 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: X-Identity-Status: Confirmed May 19 21:25:08.964183 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: X-Is-Admin-Project: True May 19 21:25:08.964183 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: X-Openstack-Nova-Api-Version: 2.90 May 19 21:25:08.964183 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: X-Project-Domain-Id: default May 19 21:25:08.964183 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: X-Project-Domain-Name: Default May 19 21:25:08.964183 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: X-Project-Id: 0436212ebbfa4ccb91d5457faaa851ee May 19 21:25:08.964183 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: X-Project-Name: admin May 19 21:25:08.964183 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: X-Role: reader,admin,member May 19 21:25:08.964183 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: X-Roles: reader,admin,member May 19 21:25:08.967312 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/0436212ebbfa4ccb91d5457faaa851ee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0436212ebbfa4ccb91d5457faaa851ee"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_0436212ebbfa4ccb91d5457faaa851ee"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0436212ebbfa4ccb91d5457faaa851ee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}] May 19 21:25:08.967312 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: X-Tenant: admin May 19 21:25:08.967312 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: X-Tenant-Id: 0436212ebbfa4ccb91d5457faaa851ee May 19 21:25:08.967312 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: X-Tenant-Name: admin May 19 21:25:08.967312 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: X-User: admin May 19 21:25:08.967312 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: X-User-Domain-Id: default May 19 21:25:08.967312 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: X-User-Domain-Name: Default May 19 21:25:08.967312 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: X-User-Id: d45bbb3805754099870efea6f5d53dfe May 19 21:25:08.967312 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: X-User-Name: admin May 19 21:25:08.967312 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: method: > May 19 21:25:08.967312 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: exception: Flavor 451 could not be found. May 19 21:25:08.967312 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: action_args: {'id': '451'} May 19 21:25:08.967312 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: {{(pid=103210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 21:25:08.967312 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:25:08.969078 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 19 21:25:08.969078 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 19 21:25:08.969078 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 19 21:25:08.969078 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 19 21:25:08.969078 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 19 21:25:08.969078 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 19 21:25:08.969078 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 19 21:25:08.969078 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 19 21:25:08.969078 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 19 21:25:08.969078 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 21:25:08.969078 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 19 21:25:08.969078 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 19 21:25:08.969078 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 19 21:25:08.969078 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi May 19 21:25:08.969078 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 21:25:08.969078 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi May 19 21:25:08.969078 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:25:08.969078 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 21:25:08.969078 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 21:25:08.971202 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 21:25:08.971202 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 21:25:08.971202 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 21:25:08.971202 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 21:25:08.971202 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 19 21:25:08.971202 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 19 21:25:08.971202 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 19 21:25:08.971202 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi May 19 21:25:08.971202 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 21:25:08.971202 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi May 19 21:25:08.971202 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:25:08.971202 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 21:25:08.971202 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 21:25:08.971202 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 21:25:08.971202 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 21:25:08.971202 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 19 21:25:08.971202 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: ERROR nova.api.openstack.wsgi May 19 21:25:08.971202 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi [None req-9cdacf00-b82a-484d-8f86-628ee90d995e admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 21:25:08.973222 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: INFO nova.api.openstack.requestlog [None req-9cdacf00-b82a-484d-8f86-628ee90d995e admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.085882 May 19 21:25:08.973222 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: [pid: 103210|app: 0|req: 24/49] 10.222.0.65 () {60 vars in 1193 bytes} [Thu May 19 21:25:08 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 19 21:25:08.977748 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi [None req-f7b3a5d0-d777-423d-a04f-5f384b32ce68 admin admin] Calling method '>' {{(pid=103209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:25:09.003373 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: INFO nova.api.openstack.requestlog [None req-f7b3a5d0-d777-423d-a04f-5f384b32ce68 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.029009 May 19 21:25:09.004262 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: [pid: 103209|app: 0|req: 26/50] 10.222.0.65 () {60 vars in 1210 bytes} [Thu May 19 21:25:08 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:25:09.020543 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi [None req-e91ba500-d5a8-4a17-81ad-c746b1f7d497 admin admin] Calling method '>' {{(pid=103210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:25:09.046363 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: INFO nova.api.openstack.requestlog [None req-e91ba500-d5a8-4a17-81ad-c746b1f7d497 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.031802 May 19 21:25:09.047277 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: [pid: 103210|app: 0|req: 25/51] 10.222.0.65 () {60 vars in 1210 bytes} [Thu May 19 21:25:09 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:25:09.058080 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi [None req-b81a7cf2-a877-474c-93f0-36866bda0665 admin admin] Calling method '>' {{(pid=103209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:25:09.065929 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: INFO nova.api.openstack.wsgi [None req-b81a7cf2-a877-474c-93f0-36866bda0665 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 19 21:25:09.067809 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi [None req-b81a7cf2-a877-474c-93f0-36866bda0665 admin admin] Request method failure captured: May 19 21:25:09.067809 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 19 21:25:09.067809 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: Accept: application/json May 19 21:25:09.067809 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: Accept-Encoding: gzip, deflate May 19 21:25:09.067809 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: Connection: keep-alive May 19 21:25:09.067809 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: Content-Length: 0 May 19 21:25:09.067809 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: Host: 10.222.0.65 May 19 21:25:09.067809 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: Openstack-Api-Version: compute 2.90 May 19 21:25:09.067809 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: Openstack-System-Scope: None May 19 21:25:09.067809 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: User-Agent: python-novaclient May 19 21:25:09.067809 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: X-Auth-Token: gAAAAABihrW0RiZ_K7BETlzEFTyYXyTb-89vGVP87H43qOuEvYUyXOZB-Bm5Lzfk-YS0DHVmZe4ncyle_R8u8cQzgktbCNG_n6Hm4WtyusjNQ8PJeZiA8yVLhhkEf0ZiQ-RPu_-hztHhYOdXLdXCZHQWSAKZFxTH9xidhppEL71bR6M2EvupCYQ May 19 21:25:09.067809 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: X-Domain-Id: None May 19 21:25:09.067809 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: X-Domain-Name: None May 19 21:25:09.067809 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: X-Identity-Status: Confirmed May 19 21:25:09.067809 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: X-Is-Admin-Project: True May 19 21:25:09.067809 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: X-Openstack-Nova-Api-Version: 2.90 May 19 21:25:09.067809 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: X-Project-Domain-Id: default May 19 21:25:09.067809 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: X-Project-Domain-Name: Default May 19 21:25:09.067809 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: X-Project-Id: 0436212ebbfa4ccb91d5457faaa851ee May 19 21:25:09.067809 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: X-Project-Name: admin May 19 21:25:09.067809 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: X-Role: reader,admin,member May 19 21:25:09.067809 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: X-Roles: reader,admin,member May 19 21:25:09.070448 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/0436212ebbfa4ccb91d5457faaa851ee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0436212ebbfa4ccb91d5457faaa851ee"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_0436212ebbfa4ccb91d5457faaa851ee"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0436212ebbfa4ccb91d5457faaa851ee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}] May 19 21:25:09.070448 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: X-Tenant: admin May 19 21:25:09.070448 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: X-Tenant-Id: 0436212ebbfa4ccb91d5457faaa851ee May 19 21:25:09.070448 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: X-Tenant-Name: admin May 19 21:25:09.070448 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: X-User: admin May 19 21:25:09.070448 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: X-User-Domain-Id: default May 19 21:25:09.070448 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: X-User-Domain-Name: Default May 19 21:25:09.070448 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: X-User-Id: d45bbb3805754099870efea6f5d53dfe May 19 21:25:09.070448 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: X-User-Name: admin May 19 21:25:09.070448 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: method: > May 19 21:25:09.070448 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: exception: Flavor 451 could not be found. May 19 21:25:09.070448 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: action_args: {'id': '451'} May 19 21:25:09.070448 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: {{(pid=103209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 21:25:09.070448 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:25:09.072459 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 19 21:25:09.072459 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 19 21:25:09.072459 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 19 21:25:09.072459 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 19 21:25:09.072459 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 19 21:25:09.072459 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 19 21:25:09.072459 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 19 21:25:09.072459 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 19 21:25:09.072459 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 19 21:25:09.072459 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 21:25:09.072459 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 19 21:25:09.072459 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 19 21:25:09.072459 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 19 21:25:09.072459 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi May 19 21:25:09.072459 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 21:25:09.072459 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi May 19 21:25:09.072459 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:25:09.072459 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 21:25:09.072459 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 21:25:09.074898 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 21:25:09.074898 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 21:25:09.074898 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 21:25:09.074898 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 21:25:09.074898 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 19 21:25:09.074898 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 19 21:25:09.074898 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 19 21:25:09.074898 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi May 19 21:25:09.074898 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 21:25:09.074898 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi May 19 21:25:09.074898 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:25:09.074898 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 21:25:09.074898 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 21:25:09.074898 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 21:25:09.074898 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 21:25:09.074898 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 19 21:25:09.074898 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: ERROR nova.api.openstack.wsgi May 19 21:25:09.074898 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi [None req-b81a7cf2-a877-474c-93f0-36866bda0665 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 21:25:09.077291 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: INFO nova.api.openstack.requestlog [None req-b81a7cf2-a877-474c-93f0-36866bda0665 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.015742 May 19 21:25:09.077291 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: [pid: 103209|app: 0|req: 27/52] 10.222.0.65 () {60 vars in 1193 bytes} [Thu May 19 21:25:09 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 19 21:25:10.182353 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi [None req-e91ba500-d5a8-4a17-81ad-c746b1f7d497 admin admin] Calling method '>' {{(pid=103210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:25:10.183540 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: INFO nova.api.openstack.requestlog [None req-e91ba500-d5a8-4a17-81ad-c746b1f7d497 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001570 May 19 21:25:10.184212 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: [pid: 103210|app: 0|req: 26/53] 10.222.0.65 () {56 vars in 1074 bytes} [Thu May 19 21:25:10 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 21:25:10.378704 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi [None req-da69b9b6-2a81-47f8-91ab-ace92b9e5aa7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:25:10.407436 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: INFO nova.api.openstack.requestlog [None req-da69b9b6-2a81-47f8-91ab-ace92b9e5aa7 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.086197 May 19 21:25:10.408123 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: [pid: 103209|app: 0|req: 28/54] 10.222.0.65 () {64 vars in 1235 bytes} [Thu May 19 21:25:10 2022] POST /compute/v2.1/flavors => generated 404 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 19 21:25:11.335640 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi [None req-e91ba500-d5a8-4a17-81ad-c746b1f7d497 admin admin] Calling method '>' {{(pid=103210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:25:11.336666 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: INFO nova.api.openstack.requestlog [None req-e91ba500-d5a8-4a17-81ad-c746b1f7d497 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001501 May 19 21:25:11.337067 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: [pid: 103210|app: 0|req: 27/55] 10.222.0.65 () {56 vars in 1074 bytes} [Thu May 19 21:25:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 21:25:11.543855 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi [None req-392a5e9e-b0a0-4be8-854e-e8f63965208c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:25:11.564569 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: INFO nova.api.openstack.requestlog [None req-392a5e9e-b0a0-4be8-854e-e8f63965208c admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.081044 May 19 21:25:11.565229 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: [pid: 103209|app: 0|req: 29/56] 10.222.0.65 () {64 vars in 1235 bytes} [Thu May 19 21:25:11 2022] POST /compute/v2.1/flavors => generated 405 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 19 21:25:12.488580 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi [None req-e91ba500-d5a8-4a17-81ad-c746b1f7d497 admin admin] Calling method '>' {{(pid=103210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:25:12.489771 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: INFO nova.api.openstack.requestlog [None req-e91ba500-d5a8-4a17-81ad-c746b1f7d497 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001602 May 19 21:25:12.490350 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: [pid: 103210|app: 0|req: 28/57] 10.222.0.65 () {56 vars in 1074 bytes} [Thu May 19 21:25:12 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 21:25:12.683455 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi [None req-768ce20a-d972-4f98-a94d-efe122f53237 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:25:12.703342 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: INFO nova.api.openstack.requestlog [None req-768ce20a-d972-4f98-a94d-efe122f53237 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.076693 May 19 21:25:12.703934 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: [pid: 103209|app: 0|req: 30/58] 10.222.0.65 () {64 vars in 1235 bytes} [Thu May 19 21:25:12 2022] POST /compute/v2.1/flavors => generated 407 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 21:25:13.696231 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi [None req-e91ba500-d5a8-4a17-81ad-c746b1f7d497 admin admin] Calling method '>' {{(pid=103210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:25:13.697296 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: INFO nova.api.openstack.requestlog [None req-e91ba500-d5a8-4a17-81ad-c746b1f7d497 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001541 May 19 21:25:13.697761 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: [pid: 103210|app: 0|req: 29/59] 10.222.0.65 () {56 vars in 1074 bytes} [Thu May 19 21:25:13 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 21:25:13.902513 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi [None req-503544a7-6a21-4d68-b2a3-3ac44a9056d6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:25:13.924681 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: INFO nova.api.openstack.requestlog [None req-503544a7-6a21-4d68-b2a3-3ac44a9056d6 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.084250 May 19 21:25:13.925251 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: [pid: 103209|app: 0|req: 31/60] 10.222.0.65 () {64 vars in 1235 bytes} [Thu May 19 21:25:13 2022] POST /compute/v2.1/flavors => generated 409 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 21:25:14.853215 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi [None req-e91ba500-d5a8-4a17-81ad-c746b1f7d497 admin admin] Calling method '>' {{(pid=103210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:25:14.854546 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: INFO nova.api.openstack.requestlog [None req-e91ba500-d5a8-4a17-81ad-c746b1f7d497 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001974 May 19 21:25:14.855058 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: [pid: 103210|app: 0|req: 30/61] 10.222.0.65 () {56 vars in 1074 bytes} [Thu May 19 21:25:14 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 21:25:15.059931 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi [None req-714bc0b7-500a-435e-9a32-9084a0aa6d1a admin admin] Calling method '>' {{(pid=103209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:25:15.080399 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: INFO nova.api.openstack.requestlog [None req-714bc0b7-500a-435e-9a32-9084a0aa6d1a admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.083910 May 19 21:25:15.080941 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: [pid: 103209|app: 0|req: 32/62] 10.222.0.65 () {60 vars in 1202 bytes} [Thu May 19 21:25:14 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:26:19.210992 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi [None req-e91ba500-d5a8-4a17-81ad-c746b1f7d497 admin admin] Calling method '>' {{(pid=103210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:26:19.211998 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: INFO nova.api.openstack.requestlog [None req-e91ba500-d5a8-4a17-81ad-c746b1f7d497 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 May 19 21:26:19.212406 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: [pid: 103210|app: 0|req: 31/63] 10.222.0.65 () {54 vars in 930 bytes} [Thu May 19 21:26:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 21:26:19.220232 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG dbcounter [-] [103209] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:19.274540 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi [None req-7b2dec14-8445-4620-ba27-7c2cbbd4b199 admin admin] Calling method '>' {{(pid=103209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:26:19.295243 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: INFO nova.api.openstack.requestlog [None req-7b2dec14-8445-4620-ba27-7c2cbbd4b199 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.076455 May 19 21:26:19.295797 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: [pid: 103209|app: 0|req: 33/64] 10.222.0.65 () {60 vars in 1291 bytes} [Thu May 19 21:26:19 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:26:19.316530 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG dbcounter [-] [103210] Writing DB stats nova_api:SELECT=14 {{(pid=103210) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:26:19.320390 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi [None req-35410d57-6539-4ccc-b6c9-bd52efe1585c admin admin] Calling method '>' {{(pid=103210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:26:19.328804 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: INFO nova.api.openstack.requestlog [None req-35410d57-6539-4ccc-b6c9-bd52efe1585c admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013711 May 19 21:26:19.329362 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: [pid: 103210|app: 0|req: 32/65] 10.222.0.65 () {60 vars in 1282 bytes} [Thu May 19 21:26:19 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:26:19.341410 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi [None req-84275075-0277-4978-9ca5-7649a8e10310 admin admin] Calling method '>' {{(pid=103209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:26:19.350075 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: INFO nova.api.openstack.requestlog [None req-84275075-0277-4978-9ca5-7649a8e10310 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012516 May 19 21:26:19.350677 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: [pid: 103209|app: 0|req: 34/66] 10.222.0.65 () {60 vars in 1285 bytes} [Thu May 19 21:26:19 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:26:19.364333 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi [None req-9af0c03a-b3ab-4350-8cf5-b7ff19240741 admin admin] Calling method '>' {{(pid=103210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:26:19.373686 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: INFO nova.api.openstack.requestlog [None req-9af0c03a-b3ab-4350-8cf5-b7ff19240741 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013515 May 19 21:26:19.374231 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: [pid: 103210|app: 0|req: 33/67] 10.222.0.65 () {60 vars in 1285 bytes} [Thu May 19 21:26:19 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:26:19.386531 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi [None req-48fb9fe5-70e1-42e0-b749-96c9a0e78154 admin admin] Calling method '>' {{(pid=103209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:26:19.394935 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: INFO nova.api.openstack.requestlog [None req-48fb9fe5-70e1-42e0-b749-96c9a0e78154 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012281 May 19 21:26:19.395500 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: [pid: 103209|app: 0|req: 35/68] 10.222.0.65 () {60 vars in 1282 bytes} [Thu May 19 21:26:19 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:30:04.314692 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi [None req-9af0c03a-b3ab-4350-8cf5-b7ff19240741 admin admin] Calling method '>' {{(pid=103210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:30:04.316237 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: INFO nova.api.openstack.requestlog [None req-9af0c03a-b3ab-4350-8cf5-b7ff19240741 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002224 May 19 21:30:04.316833 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: [pid: 103210|app: 0|req: 34/69] 10.222.0.65 () {56 vars in 1074 bytes} [Thu May 19 21:30:04 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 21:30:04.471668 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG dbcounter [-] [103209] Writing DB stats nova_api:SELECT=6 {{(pid=103209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:30:04.602487 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi [None req-5a6dffc5-73dd-4669-895f-17de28f70b08 admin admin] Calling method '>' {{(pid=103209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:30:04.603740 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 21:30:04.603740 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: warnings.warn(msg) May 19 21:30:04.604971 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG oslo_concurrency.lockutils [None req-5a6dffc5-73dd-4669-895f-17de28f70b08 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:30:04.605410 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG oslo_concurrency.lockutils [None req-5a6dffc5-73dd-4669-895f-17de28f70b08 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:30:04.606313 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG oslo_concurrency.lockutils [None req-5a6dffc5-73dd-4669-895f-17de28f70b08 admin admin] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:30:04.606674 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG oslo_concurrency.lockutils [None req-5a6dffc5-73dd-4669-895f-17de28f70b08 admin admin] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:30:04.642749 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: INFO nova.api.openstack.requestlog [None req-5a6dffc5-73dd-4669-895f-17de28f70b08 admin admin] 10.222.0.65 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.172631 May 19 21:30:04.643342 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: [pid: 103209|app: 0|req: 36/70] 10.222.0.65 () {60 vars in 1193 bytes} [Thu May 19 21:30:04 2022] GET /compute/v2.1/os-services => generated 791 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 21:30:05.543027 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi [None req-9af0c03a-b3ab-4350-8cf5-b7ff19240741 admin admin] Calling method '>' {{(pid=103210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:30:05.544496 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: INFO nova.api.openstack.requestlog [None req-9af0c03a-b3ab-4350-8cf5-b7ff19240741 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001721 May 19 21:30:05.544952 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: [pid: 103210|app: 0|req: 35/71] 10.222.0.65 () {56 vars in 1074 bytes} [Thu May 19 21:30:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 21:30:05.748634 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi [None req-7e828edb-6c19-437e-a923-ca5189bbf6e1 admin admin] Calling method '>' {{(pid=103209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:30:05.749953 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 21:30:05.749953 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: warnings.warn(msg) May 19 21:30:05.751415 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG oslo_concurrency.lockutils [None req-7e828edb-6c19-437e-a923-ca5189bbf6e1 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:30:05.751879 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG oslo_concurrency.lockutils [None req-7e828edb-6c19-437e-a923-ca5189bbf6e1 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:30:05.752684 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG oslo_concurrency.lockutils [None req-7e828edb-6c19-437e-a923-ca5189bbf6e1 admin admin] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:30:05.753105 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG oslo_concurrency.lockutils [None req-7e828edb-6c19-437e-a923-ca5189bbf6e1 admin admin] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:30:05.773570 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: INFO nova.api.openstack.requestlog [None req-7e828edb-6c19-437e-a923-ca5189bbf6e1 admin admin] 10.222.0.65 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.091243 May 19 21:30:05.774154 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: [pid: 103209|app: 0|req: 37/72] 10.222.0.65 () {60 vars in 1193 bytes} [Thu May 19 21:30:05 2022] GET /compute/v2.1/os-services => generated 791 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 21:30:17.092520 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi [None req-9af0c03a-b3ab-4350-8cf5-b7ff19240741 admin admin] Calling method '>' {{(pid=103210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:30:17.093500 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: INFO nova.api.openstack.requestlog [None req-9af0c03a-b3ab-4350-8cf5-b7ff19240741 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 May 19 21:30:17.093886 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: [pid: 103210|app: 0|req: 36/73] 10.222.0.65 () {56 vars in 1074 bytes} [Thu May 19 21:30:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 21:30:17.262563 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG dbcounter [-] [103209] Writing DB stats nova_cell0:SELECT=4 {{(pid=103209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:30:17.263651 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG dbcounter [-] [103209] Writing DB stats nova_cell1:SELECT=4 {{(pid=103209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:30:17.263836 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG dbcounter [-] [103209] Writing DB stats nova_api:SELECT=8 {{(pid=103209) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:30:17.318535 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi [None req-58eac97c-1cff-4c12-af6b-ac723ca74ce8 admin admin] Calling method '>' {{(pid=103209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:30:17.319710 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 21:30:17.319710 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: warnings.warn(msg) May 19 21:30:17.320892 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG oslo_concurrency.lockutils [None req-58eac97c-1cff-4c12-af6b-ac723ca74ce8 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:30:17.321333 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG oslo_concurrency.lockutils [None req-58eac97c-1cff-4c12-af6b-ac723ca74ce8 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:30:17.322097 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG oslo_concurrency.lockutils [None req-58eac97c-1cff-4c12-af6b-ac723ca74ce8 admin admin] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:30:17.322543 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG oslo_concurrency.lockutils [None req-58eac97c-1cff-4c12-af6b-ac723ca74ce8 admin admin] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:30:17.351200 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: INFO nova.api.openstack.requestlog [None req-58eac97c-1cff-4c12-af6b-ac723ca74ce8 admin admin] 10.222.0.65 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.095808 May 19 21:30:17.351786 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: [pid: 103209|app: 0|req: 38/74] 10.222.0.65 () {60 vars in 1193 bytes} [Thu May 19 21:30:17 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:30:18.380756 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: DEBUG nova.api.openstack.wsgi [None req-9af0c03a-b3ab-4350-8cf5-b7ff19240741 admin admin] Calling method '>' {{(pid=103210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:30:18.381759 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: INFO nova.api.openstack.requestlog [None req-9af0c03a-b3ab-4350-8cf5-b7ff19240741 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 May 19 21:30:18.382131 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: [pid: 103210|app: 0|req: 37/75] 10.222.0.65 () {56 vars in 1074 bytes} [Thu May 19 21:30:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 21:30:18.597836 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG nova.api.openstack.wsgi [None req-0cffbee4-c52c-4f4b-8978-c70f5c801e7b admin admin] Calling method '>' {{(pid=103209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:30:18.599061 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 21:30:18.599061 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: warnings.warn(msg) May 19 21:30:18.600269 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG oslo_concurrency.lockutils [None req-0cffbee4-c52c-4f4b-8978-c70f5c801e7b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:30:18.601083 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG oslo_concurrency.lockutils [None req-0cffbee4-c52c-4f4b-8978-c70f5c801e7b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:30:18.601871 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG oslo_concurrency.lockutils [None req-0cffbee4-c52c-4f4b-8978-c70f5c801e7b admin admin] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:30:18.602312 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: DEBUG oslo_concurrency.lockutils [None req-0cffbee4-c52c-4f4b-8978-c70f5c801e7b admin admin] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:30:18.624113 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: INFO nova.api.openstack.requestlog [None req-0cffbee4-c52c-4f4b-8978-c70f5c801e7b admin admin] 10.222.0.65 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.087053 May 19 21:30:18.624700 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: [pid: 103209|app: 0|req: 39/76] 10.222.0.65 () {60 vars in 1193 bytes} [Thu May 19 21:30:18 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:31:18.207426 dv-cinder-835635-2-iscsi devstack@n-api.service[103208]: Thu May 19 21:31:18 2022 - graceful shutdown triggered... May 19 21:31:18.208062 dv-cinder-835635-2-iscsi devstack@n-api.service[103209]: Gracefully killing worker 1 (pid: 103209)... May 19 21:31:18.208479 dv-cinder-835635-2-iscsi devstack@n-api.service[103210]: Gracefully killing worker 2 (pid: 103210)... May 19 21:31:18.209678 dv-cinder-835635-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... May 19 21:31:19.209275 dv-cinder-835635-2-iscsi devstack@n-api.service[103208]: worker 1 buried after 1 seconds May 19 21:31:19.209275 dv-cinder-835635-2-iscsi devstack@n-api.service[103208]: worker 2 buried after 1 seconds May 19 21:31:19.209275 dv-cinder-835635-2-iscsi devstack@n-api.service[103208]: goodbye to uWSGI. May 19 21:31:19.210987 dv-cinder-835635-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. May 19 21:31:19.211572 dv-cinder-835635-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. May 19 21:31:19.214372 dv-cinder-835635-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 19 21:31:19.229866 dv-cinder-835635-2-iscsi devstack@n-api.service[124338]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 19 21:31:19.241059 dv-cinder-835635-2-iscsi devstack@n-api.service[124338]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu May 19 21:31:19 2022] *** May 19 21:31:19.241059 dv-cinder-835635-2-iscsi devstack@n-api.service[124338]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 19 21:31:19.241059 dv-cinder-835635-2-iscsi devstack@n-api.service[124338]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 19 21:31:19.241059 dv-cinder-835635-2-iscsi devstack@n-api.service[124338]: nodename: dv-cinder-835635-2-iscsi May 19 21:31:19.241059 dv-cinder-835635-2-iscsi devstack@n-api.service[124338]: machine: x86_64 May 19 21:31:19.241059 dv-cinder-835635-2-iscsi devstack@n-api.service[124338]: clock source: unix May 19 21:31:19.241059 dv-cinder-835635-2-iscsi devstack@n-api.service[124338]: pcre jit disabled May 19 21:31:19.241059 dv-cinder-835635-2-iscsi devstack@n-api.service[124338]: detected number of CPU cores: 4 May 19 21:31:19.241059 dv-cinder-835635-2-iscsi devstack@n-api.service[124338]: current working directory: / May 19 21:31:19.241059 dv-cinder-835635-2-iscsi devstack@n-api.service[124338]: detected binary path: /usr/bin/uwsgi-core May 19 21:31:19.241059 dv-cinder-835635-2-iscsi devstack@n-api.service[124338]: your processes number limit is 47680 May 19 21:31:19.241059 dv-cinder-835635-2-iscsi devstack@n-api.service[124338]: your memory page size is 4096 bytes May 19 21:31:19.241059 dv-cinder-835635-2-iscsi devstack@n-api.service[124338]: detected max file descriptor number: 2048 May 19 21:31:19.241059 dv-cinder-835635-2-iscsi devstack@n-api.service[124338]: lock engine: pthread robust mutexes May 19 21:31:19.242092 dv-cinder-835635-2-iscsi devstack@n-api.service[124338]: thunder lock: enabled May 19 21:31:19.242092 dv-cinder-835635-2-iscsi devstack@n-api.service[124338]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 19 21:31:19.242092 dv-cinder-835635-2-iscsi devstack@n-api.service[124338]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 19 21:31:19.289839 dv-cinder-835635-2-iscsi devstack@n-api.service[124338]: Python main interpreter initialized at 0x55c60b6aa9c0 May 19 21:31:19.289839 dv-cinder-835635-2-iscsi devstack@n-api.service[124338]: python threads support enabled May 19 21:31:19.289839 dv-cinder-835635-2-iscsi devstack@n-api.service[124338]: your server socket listen backlog is limited to 100 connections May 19 21:31:19.289839 dv-cinder-835635-2-iscsi devstack@n-api.service[124338]: your mercy for graceful operations on workers is 90 seconds May 19 21:31:19.290354 dv-cinder-835635-2-iscsi devstack@n-api.service[124338]: mapped 403077 bytes (393 KB) for 2 cores May 19 21:31:19.290423 dv-cinder-835635-2-iscsi devstack@n-api.service[124338]: *** Operational MODE: preforking *** May 19 21:31:19.290763 dv-cinder-835635-2-iscsi devstack@n-api.service[124338]: *** uWSGI is running in multiple interpreter mode *** May 19 21:31:19.290763 dv-cinder-835635-2-iscsi devstack@n-api.service[124338]: spawned uWSGI master process (pid: 124338) May 19 21:31:19.290972 dv-cinder-835635-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 19 21:31:19.291601 dv-cinder-835635-2-iscsi devstack@n-api.service[124338]: spawned uWSGI worker 1 (pid: 124349, cores: 1) May 19 21:31:19.291975 dv-cinder-835635-2-iscsi devstack@n-api.service[124338]: spawned uWSGI worker 2 (pid: 124350, cores: 1) May 19 21:31:19.296401 dv-cinder-835635-2-iscsi devstack@n-api.service[124338]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 19 21:31:20.527558 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 19 21:31:20.592954 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 19 21:31:21.325989 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 19 21:31:21.325989 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: from cryptography.utils import int_from_bytes May 19 21:31:21.326310 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 19 21:31:21.326310 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: from cryptography.utils import int_from_bytes May 19 21:31:21.392233 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 19 21:31:21.392233 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: from cryptography.utils import int_from_bytes May 19 21:31:21.392551 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 19 21:31:21.392551 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: from cryptography.utils import int_from_bytes May 19 21:31:23.772289 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 19 21:31:23.772896 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 19 21:31:23.773182 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 19 21:31:23.773441 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 19 21:31:23.773690 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 19 21:31:23.774282 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.774615 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.774928 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.775404 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.775739 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.776052 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.776376 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.776729 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.777054 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.777283 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.777598 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.777947 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-835635-2-iscsi {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.778271 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.778594 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.778900 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.779215 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.779493 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.779837 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.780135 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.780631 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.781997 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.781997 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.781997 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.781997 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.782457 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.782545 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.782902 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.783177 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.783498 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.783861 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.784201 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-835635-2-iscsi {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.784512 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.784818 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.785124 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.785557 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.785847 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.786149 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.786536 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.786860 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.787185 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.787573 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.787892 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.788209 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.788524 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.788819 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.789123 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.789433 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.789747 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.790048 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.790373 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.790618 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.790919 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.791237 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.791553 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.791864 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.792116 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.792355 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.792672 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.792988 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.793292 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.793593 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.793893 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.794202 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.794521 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.794821 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.795124 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.795416 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.795729 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.796046 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.796357 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.796657 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.796972 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.797367 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.65 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.797615 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.65 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.797925 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.798408 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.798583 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.798884 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.799203 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.799518 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.799821 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.800122 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.800671 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.800989 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.801331 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.801633 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.802010 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.802542 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.802974 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.803368 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.803677 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.803983 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.804598 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.804751 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.805066 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.805370 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.805706 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.806012 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.806308 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.806642 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.806946 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.807236 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.807529 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.807877 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.808192 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.808496 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.808826 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.809125 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.809436 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.809722 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.810052 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.810461 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.810950 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.811263 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.811568 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.811920 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.812291 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.812750 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.813039 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.813313 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.813645 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.813962 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.814264 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.814600 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.814903 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.815266 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.815463 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.815831 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.816087 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.816360 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.816687 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.817084 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.817285 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.817717 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.817967 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.818459 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.818799 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.819152 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.819452 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.819793 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.820146 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.820433 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.820764 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.821081 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.821392 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.821704 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.822030 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.822368 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.822677 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.823075 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.823400 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.823768 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.824054 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.824342 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.824657 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.824974 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.825284 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.825603 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.826029 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.826320 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.826590 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.826943 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.827272 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.827586 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.828075 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.828243 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.828543 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.828847 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.829155 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.829486 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.829816 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.830125 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.830472 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.830776 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.831083 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.831390 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.831715 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.832016 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.832361 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.832670 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.832985 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.833415 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.833666 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.833976 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.834299 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.834608 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.834910 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.835211 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.835512 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.835827 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.836247 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.836445 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.836776 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.837080 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.837416 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.837721 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.838032 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.838373 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.838737 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.838986 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.839299 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.839657 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.839915 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.840243 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.840634 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.840851 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.841176 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.841478 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.841782 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.842098 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.842441 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.842750 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.843061 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.843371 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.843698 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.844091 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.844315 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.844647 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.844976 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.845281 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.845606 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.845964 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.846485 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.846647 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.856431 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.856431 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.856431 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.856431 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.856431 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.856431 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.856431 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.856431 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.860928 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.860928 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.860928 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.860928 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.860928 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.860928 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.860928 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.860928 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.862666 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.862666 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.862666 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.862666 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.862666 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.862666 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.862666 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.862666 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.863779 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.863959 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 19 21:31:23.864804 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.865124 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 19 21:31:23.865270 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.865270 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.865556 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 19 21:31:23.865711 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.865851 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 19 21:31:23.865990 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.866129 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 19 21:31:23.866300 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.866455 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.866608 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.866756 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.866894 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.867053 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.867192 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.867338 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.867486 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.867633 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.867771 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.867909 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.868054 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.868203 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.868342 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.868480 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.868624 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.868775 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.868934 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.869087 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.870216 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.870390 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.870541 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.870688 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-835635-2-iscsi {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.870839 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.870993 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.871132 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.871278 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.871424 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.871563 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.871701 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.871874 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.872022 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.872168 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.872306 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.872444 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.872595 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.872743 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.872882 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.872882 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.873146 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.873313 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.873530 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.873695 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.873837 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.873986 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.874126 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.874126 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.874451 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.874451 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.874734 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.875035 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.875190 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.875337 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.875496 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.875645 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.875785 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.875923 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.876071 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.876217 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.876366 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.876513 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.876652 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-835635-2-iscsi {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.876791 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.876936 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.877084 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.877224 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.877383 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.877383 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.877647 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.877785 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.877934 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.878075 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.878214 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.878401 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.878550 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.878696 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.878845 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.878985 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.879125 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.879288 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.880447 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.880613 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.880757 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.880904 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.881053 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.881193 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.881340 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.881495 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.881643 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.881782 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.881922 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.882059 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.882214 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.882391 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.882532 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.882670 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.882810 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.882957 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.883104 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.883252 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.883394 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.883643 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.883786 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.883933 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.884094 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.884240 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.884384 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.884523 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.884669 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.884816 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.884969 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.885257 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.885404 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.885553 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.885732 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.885877 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.886046 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.886200 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.886402 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.886703 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.886858 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.887012 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.887153 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.887291 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.887431 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.887570 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.887718 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.887944 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.888104 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.888243 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.888382 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.888520 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.888660 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.888811 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.888952 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.889097 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.889244 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.889382 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.889751 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.890161 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.890572 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.890846 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.890992 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.891130 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.891289 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.891430 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.891569 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.65 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.891716 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.891904 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.65 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.892061 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.892211 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.892350 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.892496 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.892636 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.892794 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.892967 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.893116 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.893262 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.893262 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.893535 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.893673 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.893821 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.893990 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.894142 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.894439 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.894684 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.894948 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.895156 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.895464 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.895725 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.895872 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.896014 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.896165 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.896306 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.896306 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.896568 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.896724 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.896978 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.897123 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.897280 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.897429 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.897568 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.897721 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.897860 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.897860 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.898132 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.898435 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.898592 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.898749 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.898889 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.899027 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.899166 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.899314 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.899459 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.899605 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.899965 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.900338 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.900698 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.900861 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.901127 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.901285 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.901434 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.901573 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.901713 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.901859 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.902026 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.902026 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.902402 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.902553 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.902692 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.902844 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.902998 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.903153 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.903294 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.903432 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.903582 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.903721 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.903867 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.904023 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.904178 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.904338 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.904477 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.904617 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.904754 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.904899 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.905038 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.905186 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.905325 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.905490 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.905750 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.905912 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.906061 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.906200 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.906375 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.906526 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.906671 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.906818 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.906988 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.907222 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.907368 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.907517 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.907663 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.907803 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.907966 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.908113 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.908334 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.908485 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.908624 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.908776 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.908929 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.909080 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.909219 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.909357 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.909496 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.909643 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.909790 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.910127 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.910501 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.910838 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.910984 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.911204 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.911590 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.911761 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.911761 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.912035 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.912176 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.912346 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.912562 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.912710 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.912862 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.913009 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.913149 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.913302 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.913450 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 21:31:23.913596 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.913750 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.913898 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.914037 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.914196 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.914196 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.914506 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.914666 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.914815 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.914967 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.915106 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.915246 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.915393 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.915540 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.915687 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.915947 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.916102 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.916249 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.916389 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.916527 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.916677 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.916824 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.916972 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.917117 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.917354 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.917507 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.917728 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.917870 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.918118 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.918314 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.918474 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.918614 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.918762 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.918919 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.919069 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.919208 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.919353 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.919498 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.919645 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.919783 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.919936 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.920272 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.920272 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.920776 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.921113 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.921264 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.921426 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.921584 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.921841 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.921996 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.922137 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.922306 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.922462 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.922610 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.922750 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.922897 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.923037 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.923177 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.923326 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.923466 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.923614 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.923767 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.923908 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.923908 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.924189 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.924332 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.924472 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.924624 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.924765 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.924903 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.925049 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.925049 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.925344 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.925344 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.925624 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.925764 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.925910 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.926209 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.926388 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.926530 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.926669 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.926895 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.927245 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.927539 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.927713 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.927892 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.928097 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.928097 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.928375 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.928516 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.928668 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.928816 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.928963 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.929110 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.929249 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.929394 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.929544 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.929706 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.929853 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.930000 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.930146 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.930604 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.931200 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.931359 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.931359 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.931634 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.931781 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.932079 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.932232 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.932389 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.932536 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.932675 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.932815 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.932968 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.933108 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.933246 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.933393 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.933544 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.933692 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.933839 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.933985 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.934139 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.934310 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.934455 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.934609 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.934880 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.935047 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.935197 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.935337 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.935484 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.935631 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.935771 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.935928 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.936081 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.936246 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.936546 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.936707 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.936849 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.937003 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.937143 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.937282 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.937430 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.937683 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.937838 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.937985 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.938133 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.938300 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.938454 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.938607 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.938746 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.938887 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.939032 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.939172 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.939320 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.939468 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.939616 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.939765 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.939913 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.940061 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.940209 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.940366 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.940533 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.940898 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.941417 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.941575 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.941718 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.941872 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.942027 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.942353 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.942595 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.942760 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.942915 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.943063 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.943221 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.943376 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.943522 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.943676 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.943830 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.943984 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.944142 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.944296 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.944442 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.944637 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.944785 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.944938 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.945092 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.945258 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.945418 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.945574 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.945737 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.946011 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.946162 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.946332 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.946497 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.946773 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.946924 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.947079 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.947868 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.948047 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.948203 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.948351 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.948493 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.948612 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.948722 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.948839 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.949030 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.949175 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.949175 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.949461 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.949461 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.949767 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.949913 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.950057 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.950208 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.950389 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.950539 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.950711 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.951085 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.951604 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.951760 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.951908 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.952068 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.952216 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.952512 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.952667 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.952813 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.952960 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.953191 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.953340 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.953485 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.953638 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.953785 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.953938 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.954107 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.954312 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.954477 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.954641 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.954787 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.954934 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.955088 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.955235 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.955387 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.955541 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.955689 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.955845 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.956016 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.956242 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.956393 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.956393 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.956698 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.956982 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.957145 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.957303 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.957457 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.957604 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.957604 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.958015 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.958275 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.958546 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.958712 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.958863 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.959020 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.959020 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.959313 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.959466 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.959623 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.959776 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.959776 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.960071 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.960225 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.960372 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.960517 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.960670 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.960916 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.961265 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.961671 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.961826 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.961982 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.962128 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.962301 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.962462 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.962838 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.962987 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.963142 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.963289 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.963289 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.963582 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.963582 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.963883 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.964047 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.964211 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.964358 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.964503 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.964656 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.964809 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.964962 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.965124 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.965270 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.965423 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.965569 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.965726 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.965879 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.966038 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.966186 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.966434 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.966587 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.966734 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.966880 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.967148 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.967311 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.967311 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.967311 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.967765 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.967926 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.968161 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.968322 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.968484 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.968631 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.968631 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.968926 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.969072 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.969226 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.969373 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.969518 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.969663 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.969831 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.969977 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.970130 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.970359 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.970513 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.970657 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.970657 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.970657 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.971097 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.971417 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.971811 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.971811 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.972120 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.972278 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.972432 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.972580 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.972732 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.973003 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.973157 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.973775 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.973946 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.974097 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.974260 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.974431 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.974618 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.974830 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.974992 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.975139 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.975295 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.975459 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.975614 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.975760 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.975906 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.976059 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.976215 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.976360 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.976595 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.976758 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.976904 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.977060 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.977322 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.977475 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.977621 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.977776 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.977922 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.978066 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.978066 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.978518 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.978666 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.978819 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.978974 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.979132 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.979293 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.979293 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.979571 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.979724 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.979879 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.980025 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.980178 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.980325 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.980509 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.980674 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.980823 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.980978 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.980978 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.981270 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.981568 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.981957 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.982126 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.982302 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.982456 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.982610 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.982757 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.982910 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.982910 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.983312 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.983460 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.983626 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.983780 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.983945 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.984103 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.984342 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.984502 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.984502 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.984782 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.984782 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.985072 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.985072 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.985351 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.985516 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.985671 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.985850 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.986009 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.986157 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.986342 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.986501 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.986745 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.986904 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.987052 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.987199 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.987362 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.987362 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.987757 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.987915 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.988071 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.988220 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.988456 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.988617 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.988772 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.988919 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.989075 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.989230 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.989529 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.989750 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.989963 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.989963 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.989963 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.989963 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.990633 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.990781 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.990927 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.991072 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.991218 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.991365 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.991365 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.992132 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.992306 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.992466 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.992613 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.992774 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.992923 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.993071 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.993216 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.993380 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.993616 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.993777 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.993933 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.994088 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.994088 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.994440 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.994708 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.994889 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.995048 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.995194 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.995194 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.995471 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.995631 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.995779 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.995925 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.996070 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.996223 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.996393 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.996393 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.996682 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.996682 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.997054 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.997199 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.997354 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.997510 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.997760 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.997928 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.998075 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.998249 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.998405 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.998663 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.998817 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.998962 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.999108 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.999267 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.999414 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.999560 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.999715 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:23.999862 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.000007 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.000007 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.000300 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.000454 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.000617 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.000766 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.000919 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.001075 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.001222 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.001375 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.001528 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.001840 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.002022 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.002425 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.002591 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.002738 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.002904 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.003051 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.003211 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.003367 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.003528 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.003783 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.003947 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.004104 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.004263 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.004417 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.004570 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.004723 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.004874 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.005128 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.005301 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.005457 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.005612 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.005766 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.005913 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.006076 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.006224 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.006407 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.006563 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.006717 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.006872 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.007118 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.007283 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.007430 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.007583 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.007729 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.007984 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.008147 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.008295 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.008448 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.008595 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.008832 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.008993 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.009160 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.009315 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.009481 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.009634 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.009781 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.009936 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.009936 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.010223 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.010434 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.010590 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.010590 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.010884 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.010884 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.011179 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.011327 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.011327 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.011614 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.011614 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.012058 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.012436 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.012594 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.012741 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.012895 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.012895 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.013184 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.013184 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.013470 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.013636 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.013822 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.014059 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.014218 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.014399 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.014546 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.014692 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.014916 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.015065 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.015219 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.015366 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.015513 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.015658 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.015828 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.015985 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.016140 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.016295 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.016451 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.016599 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.016758 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.016904 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.017050 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.017277 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.017437 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.017600 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.017753 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.017910 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.018163 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.018335 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.018482 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.018642 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.018804 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.019115 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.019280 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.019437 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.019584 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.019741 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.019895 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.020040 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.020197 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.020343 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.020490 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.020733 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.020892 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.021047 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.021193 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.021347 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.021508 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.021655 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.021802 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.022116 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.022583 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.022756 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.024252 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.024418 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.024576 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.024725 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.024880 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.025036 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.025190 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.025337 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.025501 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.025681 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.025844 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.026005 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.026159 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.026331 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.026493 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.026640 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.026785 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.026931 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.027087 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.027469 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.027637 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.027794 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.027959 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.028114 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.028387 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.028558 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.028714 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.028861 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.029032 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.029273 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.029273 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.029574 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.029574 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.029855 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.030012 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.030159 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.030332 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.030499 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.030646 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.030646 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.030940 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.030940 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.031228 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.031228 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.031508 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.031508 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.031784 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.031784 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.032166 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.032408 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.032829 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.032986 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.033223 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.033374 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.033530 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.033686 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.033841 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.033996 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.034143 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.034647 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.034815 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.034962 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.035109 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.035255 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.035411 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.035567 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.035714 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.035867 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.036023 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.036468 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.036618 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.036778 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.036939 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.037085 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.037230 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.037384 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.037707 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.037868 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.038034 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.038205 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.038419 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.038712 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.038876 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.039037 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.039192 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.039463 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.039625 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.039772 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.039927 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.040073 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.040226 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.040381 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.040381 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.040667 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.040828 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.040977 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.041123 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.041269 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.041432 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.041579 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.041739 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.041886 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.042031 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.042176 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.042414 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.042414 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.043078 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.043249 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.043485 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.043644 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.043804 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.043963 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.044119 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.044119 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.044413 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.044413 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.044809 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.044809 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.045110 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.045256 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.045402 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.045547 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.045698 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.045870 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.046024 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.046177 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.046369 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.046495 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.046589 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.046692 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.046787 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.046881 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.046968 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.046968 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.047237 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.047325 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.047325 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.047325 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.047325 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.047325 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.047713 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.047799 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.047799 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.047962 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.048054 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.048139 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.048232 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.048327 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.048413 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.048504 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.048589 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.048685 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.048768 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.048768 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.048905 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.048984 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.049064 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.049146 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.049220 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.049298 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.049377 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.049452 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.049530 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.049610 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.049683 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.049754 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.049832 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.049904 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.049974 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.050072 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.050153 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.050232 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.050335 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.050407 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.050497 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.050579 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.050651 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.050651 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.050781 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.050851 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.050930 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.051011 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.051083 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.051083 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.051235 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.051314 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.051400 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.051498 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.051575 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.051656 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.051729 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.051854 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.051854 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124349) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 19 21:31:24.052038 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.052038 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.052038 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.052038 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.052038 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.052038 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.052038 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.052038 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.052907 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.052907 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.052907 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.052907 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.052907 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.052907 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.052907 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.052907 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.053421 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.053421 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.053421 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.053421 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.053421 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.053421 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.053421 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.053421 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.053950 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.053950 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.053950 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.053950 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.053950 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.053950 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.053950 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.053950 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.054519 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.054519 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.054519 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.054519 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.054519 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.054519 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.054519 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.054519 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.055062 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.055062 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.055062 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.055062 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.055062 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.055062 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.055062 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.055062 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.055562 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.055562 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.055562 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.055562 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.055562 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.055562 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.055562 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.055562 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.056098 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.056098 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.056098 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.056098 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.056098 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.056098 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.056098 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.056098 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.056591 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.056591 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.056591 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.056591 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.056591 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.056591 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.056591 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.057031 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.057031 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.057031 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.057031 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.057031 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.057031 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.057031 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.057466 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.057643 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.058882 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.058882 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.059080 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.059296 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.059622 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.059958 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.060301 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.060633 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.060955 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.061277 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.061600 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.062136 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.062485 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.062892 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.063284 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.063616 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.063923 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.064248 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.064590 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.064903 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.065215 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.065559 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.065856 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.066166 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.066522 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.066883 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.067242 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.067712 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.068059 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.068612 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.068966 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.069290 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.069623 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.069955 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.070299 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.070618 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.070951 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.071265 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.071578 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.071899 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.072213 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.072522 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.072832 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.073151 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.073466 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.073775 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.074091 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.074433 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.074767 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.075079 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.075392 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.075701 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.076014 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.076322 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.076629 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.076937 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.077247 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.077565 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.077877 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.078188 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.078528 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.078839 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.079167 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.079464 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.079830 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.080153 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.080461 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.080771 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.081092 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.081405 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.081733 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.082049 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.082384 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.082739 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.083110 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.083706 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.084041 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.084365 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.084702 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.085038 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.085355 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.085665 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.085977 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.086334 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.086652 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.086967 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.087279 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.087592 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.087906 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.088320 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.088530 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.088843 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.089155 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.089467 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.089781 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.090092 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.090433 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.090785 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.091104 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.091423 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.091744 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.092063 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.092377 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.092651 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO dbcounter [None req-94f33b9c-6e01-4ea6-8555-b9ced4e601e6 None None] Registered counter for database nova_api May 19 21:31:24.092794 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.092991 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.093307 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.093622 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.093983 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.094334 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.094692 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.095162 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.095474 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.095799 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.096127 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.096439 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.096763 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.097087 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.097402 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.097728 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.098043 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.098814 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.099162 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.099495 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.099825 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.100139 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.100449 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.100758 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.101073 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.101396 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.101709 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.102016 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.102348 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.102663 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.102969 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.103295 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.103583 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.103891 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.104198 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.104504 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.104810 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.105117 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.105426 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.105732 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.106038 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.106371 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.106728 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.106990 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.107295 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.107599 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.107904 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.108239 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.108944 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.109559 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.109902 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.111436 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.111436 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.111436 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.111436 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.111781 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.111877 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.112169 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.112497 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.112818 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.113136 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.113454 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.113771 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.114087 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.114225 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_db.sqlalchemy.engines [None req-94f33b9c-6e01-4ea6-8555-b9ced4e601e6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124349) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 21:31:24.114582 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.114800 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.115164 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.115612 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.115763 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.116084 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.116411 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.116732 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.117047 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.117381 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.117697 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.118011 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.118353 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.118670 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.119078 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.119299 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.119621 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.119949 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.120280 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.120594 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.120926 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.121256 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.121613 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.121927 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.122205 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writer thread running {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 21:31:24.122323 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.122616 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.122938 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.123253 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.123564 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 21:31:24.123810 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 19 21:31:24.180591 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.context [None req-94f33b9c-6e01-4ea6-8555-b9ced4e601e6 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),77cb089b-88b9-45a8-a0a5-397a51f9efce(cell1) {{(pid=124349) load_cells /opt/stack/nova/nova/context.py:464}} May 19 21:31:24.183911 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO dbcounter [None req-be37e7af-aac8-4cb7-935b-9884639c2233 None None] Registered counter for database nova_api May 19 21:31:24.185076 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-94f33b9c-6e01-4ea6-8555-b9ced4e601e6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:31:24.186684 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-94f33b9c-6e01-4ea6-8555-b9ced4e601e6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:31:24.187476 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-94f33b9c-6e01-4ea6-8555-b9ced4e601e6 None None] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:31:24.189457 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-94f33b9c-6e01-4ea6-8555-b9ced4e601e6 None None] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:31:24.191520 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO dbcounter [None req-94f33b9c-6e01-4ea6-8555-b9ced4e601e6 None None] Registered counter for database nova_cell0 May 19 21:31:24.196229 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO dbcounter [None req-94f33b9c-6e01-4ea6-8555-b9ced4e601e6 None None] Registered counter for database nova_cell1 May 19 21:31:24.205005 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_db.sqlalchemy.engines [None req-94f33b9c-6e01-4ea6-8555-b9ced4e601e6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124349) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 21:31:24.207199 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_db.sqlalchemy.engines [None req-be37e7af-aac8-4cb7-935b-9884639c2233 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124350) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 21:31:24.208863 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_db.sqlalchemy.engines [None req-94f33b9c-6e01-4ea6-8555-b9ced4e601e6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124349) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 21:31:24.215045 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writer thread running {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 21:31:24.215325 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writer thread running {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 21:31:24.217634 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writer thread running {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 21:31:24.273039 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.context [None req-be37e7af-aac8-4cb7-935b-9884639c2233 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),77cb089b-88b9-45a8-a0a5-397a51f9efce(cell1) {{(pid=124350) load_cells /opt/stack/nova/nova/context.py:464}} May 19 21:31:24.277630 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-be37e7af-aac8-4cb7-935b-9884639c2233 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:31:24.279273 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-be37e7af-aac8-4cb7-935b-9884639c2233 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:31:24.280049 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-be37e7af-aac8-4cb7-935b-9884639c2233 None None] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:31:24.282030 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-be37e7af-aac8-4cb7-935b-9884639c2233 None None] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:31:24.284065 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO dbcounter [None req-be37e7af-aac8-4cb7-935b-9884639c2233 None None] Registered counter for database nova_cell0 May 19 21:31:24.288272 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO dbcounter [None req-be37e7af-aac8-4cb7-935b-9884639c2233 None None] Registered counter for database nova_cell1 May 19 21:31:24.295972 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_db.sqlalchemy.engines [None req-be37e7af-aac8-4cb7-935b-9884639c2233 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124350) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 21:31:24.297320 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_db.sqlalchemy.engines [None req-be37e7af-aac8-4cb7-935b-9884639c2233 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124350) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 21:31:24.304201 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writer thread running {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 21:31:24.305501 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writer thread running {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 21:31:24.368401 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO dbcounter [None req-94f33b9c-6e01-4ea6-8555-b9ced4e601e6 None None] Registered counter for database nova_cell0 May 19 21:31:24.375807 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_db.sqlalchemy.engines [None req-94f33b9c-6e01-4ea6-8555-b9ced4e601e6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124349) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 21:31:24.381515 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writer thread running {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 21:31:24.455270 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO dbcounter [None req-be37e7af-aac8-4cb7-935b-9884639c2233 None None] Registered counter for database nova_cell0 May 19 21:31:24.464276 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_db.sqlalchemy.engines [None req-be37e7af-aac8-4cb7-935b-9884639c2233 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124350) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 21:31:24.469369 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writer thread running {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 21:31:24.696993 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: WARNING keystonemiddleware.auth_token [None req-94f33b9c-6e01-4ea6-8555-b9ced4e601e6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 19 21:31:24.704562 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: WARNING keystonemiddleware.auth_token [None req-94f33b9c-6e01-4ea6-8555-b9ced4e601e6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 19 21:31:24.787289 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: WARNING keystonemiddleware.auth_token [None req-be37e7af-aac8-4cb7-935b-9884639c2233 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 19 21:31:24.795087 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: WARNING keystonemiddleware.auth_token [None req-be37e7af-aac8-4cb7-935b-9884639c2233 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 19 21:31:25.054225 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: WARNING keystonemiddleware.auth_token [None req-94f33b9c-6e01-4ea6-8555-b9ced4e601e6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 19 21:31:25.060554 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: WARNING keystonemiddleware.auth_token [None req-94f33b9c-6e01-4ea6-8555-b9ced4e601e6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 19 21:31:25.065915 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c60b6aa9c0 pid: 124349 (default app) May 19 21:31:25.141587 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: WARNING keystonemiddleware.auth_token [None req-be37e7af-aac8-4cb7-935b-9884639c2233 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 19 21:31:25.148065 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: WARNING keystonemiddleware.auth_token [None req-be37e7af-aac8-4cb7-935b-9884639c2233 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 19 21:31:25.153518 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c60b6aa9c0 pid: 124350 (default app) May 19 21:32:07.358356 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_api:SELECT=3 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:32:07.359387 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_cell1:SELECT=3 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:32:07.359859 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_cell0:SELECT=3 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:32:07.360850 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_cell0:SELECT=3 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:32:08.075489 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_api:SELECT=3 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:32:08.078942 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell1:SELECT=3 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:32:08.079987 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell0:SELECT=3 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:32:08.081334 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell0:SELECT=3 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:32:08.912164 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-57762a67-b1aa-403b-bb2d-b73f7c090a4f tempest-VolumesSnapshotsTestJSON-1217911260 tempest-VolumesSnapshotsTestJSON-1217911260-project] Action: 'create', calling method: .version_select at 0x7fe369658550>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1284932839"}} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:32:09.460796 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-2a1f3bc6-7210-452b-98d5-34b8863c3400 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-111284553", "imageRef": "a874457a-f8a8-46f6-bdcc-1fa632a0d3c0", "flavorRef": "452", "networks": [{"uuid": "a55d00ca-d255-49d3-88dc-d86a8a030fc4"}]}} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:32:10.923692 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.network.neutron [None req-2a1f3bc6-7210-452b-98d5-34b8863c3400 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] validate_networks() for [('a55d00ca-d255-49d3-88dc-d86a8a030fc4', None, None, None, None, None)] {{(pid=124350) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 19 21:32:11.494426 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-57762a67-b1aa-403b-bb2d-b73f7c090a4f tempest-VolumesSnapshotsTestJSON-1217911260 tempest-VolumesSnapshotsTestJSON-1217911260-project] 10.222.0.65 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 4.145949 May 19 21:32:11.502512 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 1/1] 10.222.0.65 () {60 vars in 1154 bytes} [Thu May 19 21:32:07 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 4156 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 19 21:32:11.508801 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-32358c66-e610-45d2-a5bd-fc1022fc4da8 tempest-VolumesSnapshotsTestJSON-1217911260 tempest-VolumesSnapshotsTestJSON-1217911260-project] Calling method '.version_select at 0x7fe36951c550>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:32:11.675939 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-32358c66-e610-45d2-a5bd-fc1022fc4da8 tempest-VolumesSnapshotsTestJSON-1217911260 tempest-VolumesSnapshotsTestJSON-1217911260-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/a33c1402-4ed3-49fa-beea-057029c93649" status: 200 len: 345 microversion: 2.1 time: 0.171664 May 19 21:32:11.678914 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 2/2] 10.222.0.65 () {58 vars in 1244 bytes} [Thu May 19 21:32:11 2022] GET /compute/v2.1/os-volumes/a33c1402-4ed3-49fa-beea-057029c93649 => generated 345 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 21:32:12.693652 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-df2964cf-e9e3-4552-a1ce-2011f5abfe99 tempest-VolumesSnapshotsTestJSON-1217911260 tempest-VolumesSnapshotsTestJSON-1217911260-project] Calling method '.version_select at 0x7fe36951c8b0>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:32:12.781257 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-df2964cf-e9e3-4552-a1ce-2011f5abfe99 tempest-VolumesSnapshotsTestJSON-1217911260 tempest-VolumesSnapshotsTestJSON-1217911260-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/a33c1402-4ed3-49fa-beea-057029c93649" status: 200 len: 346 microversion: 2.1 time: 0.093801 May 19 21:32:12.782379 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 3/3] 10.222.0.65 () {58 vars in 1244 bytes} [Thu May 19 21:32:12 2022] GET /compute/v2.1/os-volumes/a33c1402-4ed3-49fa-beea-057029c93649 => generated 346 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 21:32:12.798905 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-2bd87593-3650-460e-822b-c3613dd107a8 tempest-VolumesSnapshotsTestJSON-1217911260 tempest-VolumesSnapshotsTestJSON-1217911260-project] Action: 'create', calling method: .version_select at 0x7fe36951cc10>, body: {"snapshot": {"volume_id": "a33c1402-4ed3-49fa-beea-057029c93649", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1274382344"}} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:32:12.809073 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.virt.hardware [None req-2a1f3bc6-7210-452b-98d5-34b8863c3400 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Flavor limits 0:0:0 {{(pid=124350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 21:32:12.810087 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.virt.hardware [None req-2a1f3bc6-7210-452b-98d5-34b8863c3400 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Image limits 0:0:0 {{(pid=124350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 21:32:12.810719 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.virt.hardware [None req-2a1f3bc6-7210-452b-98d5-34b8863c3400 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Flavor pref 0:0:0 {{(pid=124350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 21:32:12.815039 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.virt.hardware [None req-2a1f3bc6-7210-452b-98d5-34b8863c3400 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Image pref 0:0:0 {{(pid=124350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 21:32:12.822735 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.virt.hardware [None req-2a1f3bc6-7210-452b-98d5-34b8863c3400 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 21:32:12.857761 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2a1f3bc6-7210-452b-98d5-34b8863c3400 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:32:12.858558 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2a1f3bc6-7210-452b-98d5-34b8863c3400 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:32:12.860510 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2a1f3bc6-7210-452b-98d5-34b8863c3400 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:32:12.862991 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2a1f3bc6-7210-452b-98d5-34b8863c3400 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:32:12.956166 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.quota [None req-2a1f3bc6-7210-452b-98d5-34b8863c3400 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Getting quotas for project 6166dc89ce0545c1bbb8adb947034e79. Resources: {'ram', 'cores', 'instances'} {{(pid=124350) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 21:32:12.970104 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.quota [None req-2a1f3bc6-7210-452b-98d5-34b8863c3400 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Getting quotas for user bc570204a2bb4889889a67850dd1d9fe and project 6166dc89ce0545c1bbb8adb947034e79. Resources: {'ram', 'cores', 'instances'} {{(pid=124350) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 21:32:13.008482 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-2a1f3bc6-7210-452b-98d5-34b8863c3400 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Going to run 1 instances... {{(pid=124350) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 21:32:13.024343 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-2a1f3bc6-7210-452b-98d5-34b8863c3400 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] [instance: c31d034b-2cf3-4518-8e50-8beda1897c20] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a874457a-f8a8-46f6-bdcc-1fa632a0d3c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124350) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 21:32:13.183539 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-2bd87593-3650-460e-822b-c3613dd107a8 tempest-VolumesSnapshotsTestJSON-1217911260 tempest-VolumesSnapshotsTestJSON-1217911260-project] 10.222.0.65 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.391678 May 19 21:32:13.184157 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 4/4] 10.222.0.65 () {60 vars in 1161 bytes} [Thu May 19 21:32:12 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 21:32:13.196021 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-7b348188-22d1-48d1-abee-5617e398a774 tempest-VolumesSnapshotsTestJSON-1217911260 tempest-VolumesSnapshotsTestJSON-1217911260-project] Calling method '.version_select at 0x7fe3695338b0>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:32:13.309069 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-2a1f3bc6-7210-452b-98d5-34b8863c3400 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.254735 May 19 21:32:13.318575 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 1/5] 10.222.0.65 () {60 vars in 1146 bytes} [Thu May 19 21:32:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 5265 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 21:32:13.332704 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-8e3a64b5-7588-42ea-9974-d4524fafa852 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:32:13.333579 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-8e3a64b5-7588-42ea-9974-d4524fafa852 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] [instance: c31d034b-2cf3-4518-8e50-8beda1897c20] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:32:13.467156 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-7b348188-22d1-48d1-abee-5617e398a774 tempest-VolumesSnapshotsTestJSON-1217911260 tempest-VolumesSnapshotsTestJSON-1217911260-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots/e050bad4-610d-4f8b-8769-41947fec09d6" status: 200 len: 287 microversion: 2.1 time: 0.276540 May 19 21:32:13.473740 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 5/6] 10.222.0.65 () {58 vars in 1250 bytes} [Thu May 19 21:32:13 2022] GET /compute/v2.1/os-snapshots/e050bad4-610d-4f8b-8769-41947fec09d6 => generated 287 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 21:32:13.478326 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-2819c390-3ccc-4ff2-abef-906e9fa3ebab tempest-VolumesSnapshotsTestJSON-1217911260 tempest-VolumesSnapshotsTestJSON-1217911260-project] Calling method '.version_select at 0x7fe36951cdc0>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:32:13.546653 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-2819c390-3ccc-4ff2-abef-906e9fa3ebab tempest-VolumesSnapshotsTestJSON-1217911260 tempest-VolumesSnapshotsTestJSON-1217911260-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.072292 May 19 21:32:13.553048 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 6/7] 10.222.0.65 () {58 vars in 1139 bytes} [Thu May 19 21:32:13 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 21:32:13.562107 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-8ee355e8-788a-465d-9c12-1393f7b560d3 tempest-VolumesSnapshotsTestJSON-1217911260 tempest-VolumesSnapshotsTestJSON-1217911260-project] Calling method '.version_select at 0x7fe369533940>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:32:13.661277 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-8ee355e8-788a-465d-9c12-1393f7b560d3 tempest-VolumesSnapshotsTestJSON-1217911260 tempest-VolumesSnapshotsTestJSON-1217911260-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots/e050bad4-610d-4f8b-8769-41947fec09d6" status: 200 len: 287 microversion: 2.1 time: 0.106255 May 19 21:32:13.661852 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 7/8] 10.222.0.65 () {58 vars in 1250 bytes} [Thu May 19 21:32:13 2022] GET /compute/v2.1/os-snapshots/e050bad4-610d-4f8b-8769-41947fec09d6 => generated 287 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 21:32:13.981292 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-8e3a64b5-7588-42ea-9974-d4524fafa852 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc570204a2bb4889889a67850dd1d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6166dc89ce0545c1bbb8adb947034e79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:32:14.029516 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-8e3a64b5-7588-42ea-9974-d4524fafa852 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] 10.222.0.65 "GET /compute/v2.1/servers/c31d034b-2cf3-4518-8e50-8beda1897c20" status: 200 len: 1214 microversion: 2.1 time: 0.709523 May 19 21:32:14.037340 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 2/9] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:32:13 2022] GET /compute/v2.1/servers/c31d034b-2cf3-4518-8e50-8beda1897c20 => generated 1214 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:32:14.674028 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-55e1db6e-3cac-48b2-a77b-31aa67c94b30 tempest-VolumesSnapshotsTestJSON-1217911260 tempest-VolumesSnapshotsTestJSON-1217911260-project] Calling method '.version_select at 0x7fe369533160>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:32:14.768125 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-55e1db6e-3cac-48b2-a77b-31aa67c94b30 tempest-VolumesSnapshotsTestJSON-1217911260 tempest-VolumesSnapshotsTestJSON-1217911260-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots/e050bad4-610d-4f8b-8769-41947fec09d6" status: 200 len: 287 microversion: 2.1 time: 0.097993 May 19 21:32:14.769292 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 8/10] 10.222.0.65 () {58 vars in 1250 bytes} [Thu May 19 21:32:14 2022] GET /compute/v2.1/os-snapshots/e050bad4-610d-4f8b-8769-41947fec09d6 => generated 287 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 21:32:15.054119 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-0884bc71-55d8-45a5-ab33-d222e9641ad3 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:32:15.054783 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-0884bc71-55d8-45a5-ab33-d222e9641ad3 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] [instance: c31d034b-2cf3-4518-8e50-8beda1897c20] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:32:15.359779 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-0884bc71-55d8-45a5-ab33-d222e9641ad3 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc570204a2bb4889889a67850dd1d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6166dc89ce0545c1bbb8adb947034e79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:32:15.383691 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-0884bc71-55d8-45a5-ab33-d222e9641ad3 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] 10.222.0.65 "GET /compute/v2.1/servers/c31d034b-2cf3-4518-8e50-8beda1897c20" status: 200 len: 1214 microversion: 2.1 time: 0.334376 May 19 21:32:15.384301 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 3/11] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:32:15 2022] GET /compute/v2.1/servers/c31d034b-2cf3-4518-8e50-8beda1897c20 => generated 1214 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:32:15.780799 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-1fd9174e-e00f-4196-b9c8-82c168e87de9 tempest-VolumesSnapshotsTestJSON-1217911260 tempest-VolumesSnapshotsTestJSON-1217911260-project] Calling method '.version_select at 0x7fe36951caf0>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:32:15.856987 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-1fd9174e-e00f-4196-b9c8-82c168e87de9 tempest-VolumesSnapshotsTestJSON-1217911260 tempest-VolumesSnapshotsTestJSON-1217911260-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots/e050bad4-610d-4f8b-8769-41947fec09d6" status: 200 len: 287 microversion: 2.1 time: 0.080398 May 19 21:32:15.858746 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 9/12] 10.222.0.65 () {58 vars in 1250 bytes} [Thu May 19 21:32:15 2022] GET /compute/v2.1/os-snapshots/e050bad4-610d-4f8b-8769-41947fec09d6 => generated 287 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 21:32:16.401338 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-39c18ca5-c8fa-42c4-ae94-aeef25a02551 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:32:16.401939 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-39c18ca5-c8fa-42c4-ae94-aeef25a02551 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] [instance: c31d034b-2cf3-4518-8e50-8beda1897c20] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:32:16.417493 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-39c18ca5-c8fa-42c4-ae94-aeef25a02551 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:32:16.420174 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-39c18ca5-c8fa-42c4-ae94-aeef25a02551 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:32:16.421233 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-39c18ca5-c8fa-42c4-ae94-aeef25a02551 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:32:16.423890 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-39c18ca5-c8fa-42c4-ae94-aeef25a02551 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:32:16.899566 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-696f00ba-fc32-4eb5-baa9-b757ae8f89d7 tempest-VolumesSnapshotsTestJSON-1217911260 tempest-VolumesSnapshotsTestJSON-1217911260-project] Calling method '.version_select at 0x7fe36951cee0>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:32:16.990870 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-696f00ba-fc32-4eb5-baa9-b757ae8f89d7 tempest-VolumesSnapshotsTestJSON-1217911260 tempest-VolumesSnapshotsTestJSON-1217911260-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots/e050bad4-610d-4f8b-8769-41947fec09d6" status: 200 len: 287 microversion: 2.1 time: 0.124329 May 19 21:32:16.992882 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 10/13] 10.222.0.65 () {58 vars in 1250 bytes} [Thu May 19 21:32:16 2022] GET /compute/v2.1/os-snapshots/e050bad4-610d-4f8b-8769-41947fec09d6 => generated 287 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 21:32:17.206049 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-39c18ca5-c8fa-42c4-ae94-aeef25a02551 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc570204a2bb4889889a67850dd1d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6166dc89ce0545c1bbb8adb947034e79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:32:17.230449 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-39c18ca5-c8fa-42c4-ae94-aeef25a02551 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] 10.222.0.65 "GET /compute/v2.1/servers/c31d034b-2cf3-4518-8e50-8beda1897c20" status: 200 len: 1218 microversion: 2.1 time: 0.832869 May 19 21:32:17.237097 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 4/14] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:32:16 2022] GET /compute/v2.1/servers/c31d034b-2cf3-4518-8e50-8beda1897c20 => generated 1218 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:32:18.003679 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-e895d5d2-4912-4a6e-8a8f-dd0a3f205c49 tempest-VolumesSnapshotsTestJSON-1217911260 tempest-VolumesSnapshotsTestJSON-1217911260-project] Calling method '.version_select at 0x7fe369533280>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:32:18.060828 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-e895d5d2-4912-4a6e-8a8f-dd0a3f205c49 tempest-VolumesSnapshotsTestJSON-1217911260 tempest-VolumesSnapshotsTestJSON-1217911260-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots/e050bad4-610d-4f8b-8769-41947fec09d6" status: 200 len: 287 microversion: 2.1 time: 0.060820 May 19 21:32:18.061878 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 11/15] 10.222.0.65 () {58 vars in 1250 bytes} [Thu May 19 21:32:17 2022] GET /compute/v2.1/os-snapshots/e050bad4-610d-4f8b-8769-41947fec09d6 => generated 287 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 21:32:18.256812 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-2c464e47-9887-4b90-aba6-0ca476351511 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:32:18.259147 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-2c464e47-9887-4b90-aba6-0ca476351511 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] [instance: c31d034b-2cf3-4518-8e50-8beda1897c20] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:32:18.289606 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2c464e47-9887-4b90-aba6-0ca476351511 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:32:18.292058 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2c464e47-9887-4b90-aba6-0ca476351511 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:32:18.293235 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2c464e47-9887-4b90-aba6-0ca476351511 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:32:18.295103 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2c464e47-9887-4b90-aba6-0ca476351511 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:32:18.466589 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-2c464e47-9887-4b90-aba6-0ca476351511 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc570204a2bb4889889a67850dd1d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6166dc89ce0545c1bbb8adb947034e79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:32:18.479660 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-2c464e47-9887-4b90-aba6-0ca476351511 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] 10.222.0.65 "GET /compute/v2.1/servers/c31d034b-2cf3-4518-8e50-8beda1897c20" status: 200 len: 1218 microversion: 2.1 time: 0.226480 May 19 21:32:18.481147 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 5/16] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:32:18 2022] GET /compute/v2.1/servers/c31d034b-2cf3-4518-8e50-8beda1897c20 => generated 1218 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:32:19.078079 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-583f5f70-794f-4a25-84ad-f08e04cfaf9c tempest-VolumesSnapshotsTestJSON-1217911260 tempest-VolumesSnapshotsTestJSON-1217911260-project] Calling method '.version_select at 0x7fe368396d30>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:32:19.271121 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-583f5f70-794f-4a25-84ad-f08e04cfaf9c tempest-VolumesSnapshotsTestJSON-1217911260 tempest-VolumesSnapshotsTestJSON-1217911260-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots/e050bad4-610d-4f8b-8769-41947fec09d6" status: 200 len: 288 microversion: 2.1 time: 0.197206 May 19 21:32:19.279174 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 6/17] 10.222.0.65 () {58 vars in 1250 bytes} [Thu May 19 21:32:19 2022] GET /compute/v2.1/os-snapshots/e050bad4-610d-4f8b-8769-41947fec09d6 => generated 288 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 21:32:19.284472 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-1b0277ff-54dc-4f88-a2d8-c3558a23add6 tempest-VolumesSnapshotsTestJSON-1217911260 tempest-VolumesSnapshotsTestJSON-1217911260-project] Calling method '.version_select at 0x7fe368316ee0>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:32:19.324131 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-06be1508-c890-4075-ad38-7c3655bb3230 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2050231700", "imageRef": "a874457a-f8a8-46f6-bdcc-1fa632a0d3c0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:32:19.375192 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-1b0277ff-54dc-4f88-a2d8-c3558a23add6 tempest-VolumesSnapshotsTestJSON-1217911260 tempest-VolumesSnapshotsTestJSON-1217911260-project] 10.222.0.65 "DELETE /compute/v2.1/os-snapshots/e050bad4-610d-4f8b-8769-41947fec09d6" status: 202 len: 0 microversion: 2.1 time: 0.094810 May 19 21:32:19.380014 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 7/18] 10.222.0.65 () {58 vars in 1253 bytes} [Thu May 19 21:32:19 2022] DELETE /compute/v2.1/os-snapshots/e050bad4-610d-4f8b-8769-41947fec09d6 => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 21:32:19.386833 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-d2a24edd-fde6-4c43-b703-3bf7eeaf967c tempest-VolumesSnapshotsTestJSON-1217911260 tempest-VolumesSnapshotsTestJSON-1217911260-project] Calling method '.version_select at 0x7fe3683285e0>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:32:19.467849 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-d2a24edd-fde6-4c43-b703-3bf7eeaf967c tempest-VolumesSnapshotsTestJSON-1217911260 tempest-VolumesSnapshotsTestJSON-1217911260-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots/e050bad4-610d-4f8b-8769-41947fec09d6" status: 200 len: 287 microversion: 2.1 time: 0.086152 May 19 21:32:19.468455 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 8/19] 10.222.0.65 () {58 vars in 1250 bytes} [Thu May 19 21:32:19 2022] GET /compute/v2.1/os-snapshots/e050bad4-610d-4f8b-8769-41947fec09d6 => generated 287 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 21:32:19.499853 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-6d618853-12cc-4e8e-806c-464cb81a372f tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:32:19.501697 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-6d618853-12cc-4e8e-806c-464cb81a372f tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] [instance: c31d034b-2cf3-4518-8e50-8beda1897c20] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:32:19.516619 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6d618853-12cc-4e8e-806c-464cb81a372f tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:32:19.517077 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6d618853-12cc-4e8e-806c-464cb81a372f tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:32:19.517881 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6d618853-12cc-4e8e-806c-464cb81a372f tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:32:19.518357 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6d618853-12cc-4e8e-806c-464cb81a372f tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:32:19.635281 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.network.neutron [None req-06be1508-c890-4075-ad38-7c3655bb3230 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] validate_networks() for [('c14ce0dd-3e64-476b-9ef2-fbfc9abe672b', None, None, None, None, None)] {{(pid=124349) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 19 21:32:19.897919 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-6d618853-12cc-4e8e-806c-464cb81a372f tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc570204a2bb4889889a67850dd1d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6166dc89ce0545c1bbb8adb947034e79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:32:19.911878 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-6d618853-12cc-4e8e-806c-464cb81a372f tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] 10.222.0.65 "GET /compute/v2.1/servers/c31d034b-2cf3-4518-8e50-8beda1897c20" status: 200 len: 1210 microversion: 2.1 time: 0.418010 May 19 21:32:19.928065 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 9/20] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:32:19 2022] GET /compute/v2.1/servers/c31d034b-2cf3-4518-8e50-8beda1897c20 => generated 1210 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:32:20.480062 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-d02aa870-a552-4935-ab5c-1d9886ddb09a tempest-VolumesSnapshotsTestJSON-1217911260 tempest-VolumesSnapshotsTestJSON-1217911260-project] Calling method '.version_select at 0x7fe368328e50>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:32:20.524260 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.wsgi [None req-d02aa870-a552-4935-ab5c-1d9886ddb09a tempest-VolumesSnapshotsTestJSON-1217911260 tempest-VolumesSnapshotsTestJSON-1217911260-project] HTTP exception thrown: Snapshot e050bad4-610d-4f8b-8769-41947fec09d6 could not be found. May 19 21:32:20.529112 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-d02aa870-a552-4935-ab5c-1d9886ddb09a tempest-VolumesSnapshotsTestJSON-1217911260 tempest-VolumesSnapshotsTestJSON-1217911260-project] Request method failure captured: May 19 21:32:20.529112 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: request: GET /compute/v2.1/os-snapshots/e050bad4-610d-4f8b-8769-41947fec09d6 HTTP/1.1 May 19 21:32:20.529112 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Accept: application/json May 19 21:32:20.529112 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Accept-Encoding: identity May 19 21:32:20.529112 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Connection: close May 19 21:32:20.529112 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Content-Length: 0 May 19 21:32:20.529112 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Content-Type: application/json May 19 21:32:20.529112 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Host: 10.222.0.65 May 19 21:32:20.529112 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Openstack-System-Scope: None May 19 21:32:20.529112 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: User-Agent: python-urllib3/1.26.9 May 19 21:32:20.529112 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Auth-Token: gAAAAABihrdXevjzh-M3dGxErq9MALouYasLzDKQIVT1qaxCktthDQ29eyTRppLVMsQCDfaxI03wIB1J90uaaFcr-iG1glm3EtKbfJTYsFviXzOfU7f2IlOL_uaEhbKBJ11JKTq-s8-xSjbvP7yCb__45Q42jcJRzWFz7Xk9YhwL3N1hMD1sw84 May 19 21:32:20.529112 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Domain-Id: None May 19 21:32:20.529112 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Domain-Name: None May 19 21:32:20.529112 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Identity-Status: Confirmed May 19 21:32:20.529112 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Is-Admin-Project: True May 19 21:32:20.529112 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Project-Domain-Id: default May 19 21:32:20.529112 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Project-Domain-Name: Default May 19 21:32:20.529112 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Project-Id: 8afcda833ca0433e95d6f9de6fc0df21 May 19 21:32:20.529112 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1217911260 May 19 21:32:20.529112 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Role: reader,member May 19 21:32:20.529112 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Roles: reader,member May 19 21:32:20.530154 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/8afcda833ca0433e95d6f9de6fc0df21"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/8afcda833ca0433e95d6f9de6fc0df21"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_8afcda833ca0433e95d6f9de6fc0df21"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/8afcda833ca0433e95d6f9de6fc0df21"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}] May 19 21:32:20.530154 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1217911260 May 19 21:32:20.530154 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Tenant-Id: 8afcda833ca0433e95d6f9de6fc0df21 May 19 21:32:20.530154 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1217911260 May 19 21:32:20.530154 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-User: tempest-VolumesSnapshotsTestJSON-1217911260-project May 19 21:32:20.530154 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-User-Domain-Id: default May 19 21:32:20.530154 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-User-Domain-Name: Default May 19 21:32:20.530154 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-User-Id: 04d032c7e7fb4eaaa9fdf3e92d7e28b8 May 19 21:32:20.530154 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1217911260-project May 19 21:32:20.530154 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: method: May 19 21:32:20.530154 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: exception: Snapshot e050bad4-610d-4f8b-8769-41947fec09d6 could not be found. May 19 21:32:20.530154 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: action_args: {'id': 'e050bad4-610d-4f8b-8769-41947fec09d6'} May 19 21:32:20.530154 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 21:32:20.530864 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:32:20.530864 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 19 21:32:20.530864 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 19 21:32:20.530864 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 19 21:32:20.530864 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 19 21:32:20.530864 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 19 21:32:20.530864 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 19 21:32:20.530864 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 19 21:32:20.530864 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 19 21:32:20.530864 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 19 21:32:20.530864 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 19 21:32:20.530864 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 21:32:20.530864 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 21:32:20.530864 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 21:32:20.530864 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 21:32:20.530864 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot e050bad4-610d-4f8b-8769-41947fec09d6 could not be found. (HTTP 404) (Request-ID: req-18e747f6-69c1-4b66-bdc4-d90e7b3e5c40) May 19 21:32:20.530864 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi May 19 21:32:20.530864 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 21:32:20.531695 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi May 19 21:32:20.531695 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:32:20.531695 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show May 19 21:32:20.531695 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) May 19 21:32:20.531695 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 19 21:32:20.531695 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 19 21:32:20.531695 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper May 19 21:32:20.531695 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) May 19 21:32:20.531695 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 19 21:32:20.531695 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 19 21:32:20.531695 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 19 21:32:20.531695 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 19 21:32:20.531695 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 19 21:32:20.531695 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 19 21:32:20.531695 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 19 21:32:20.531695 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 19 21:32:20.531695 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 19 21:32:20.531695 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 19 21:32:20.531695 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 19 21:32:20.532628 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 19 21:32:20.532628 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 21:32:20.532628 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 21:32:20.532628 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 21:32:20.532628 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 21:32:20.532628 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot e050bad4-610d-4f8b-8769-41947fec09d6 could not be found. May 19 21:32:20.532628 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi May 19 21:32:20.532628 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 21:32:20.532628 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi May 19 21:32:20.532628 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:32:20.532628 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 21:32:20.532628 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 21:32:20.532628 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 21:32:20.532628 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 21:32:20.532628 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 21:32:20.532628 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 21:32:20.532628 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 21:32:20.532628 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 21:32:20.532628 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show May 19 21:32:20.532628 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 21:32:20.533585 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot e050bad4-610d-4f8b-8769-41947fec09d6 could not be found. May 19 21:32:20.533585 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi May 19 21:32:20.533585 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 21:32:20.533585 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi May 19 21:32:20.533585 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:32:20.533585 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 21:32:20.533585 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 21:32:20.533585 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 21:32:20.533585 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 21:32:20.533585 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot e050bad4-610d-4f8b-8769-41947fec09d6 could not be found. May 19 21:32:20.533585 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi May 19 21:32:20.533585 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-d02aa870-a552-4935-ab5c-1d9886ddb09a tempest-VolumesSnapshotsTestJSON-1217911260 tempest-VolumesSnapshotsTestJSON-1217911260-project] Returning 404 to user: Snapshot e050bad4-610d-4f8b-8769-41947fec09d6 could not be found. {{(pid=124350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 21:32:20.535313 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-d02aa870-a552-4935-ab5c-1d9886ddb09a tempest-VolumesSnapshotsTestJSON-1217911260 tempest-VolumesSnapshotsTestJSON-1217911260-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots/e050bad4-610d-4f8b-8769-41947fec09d6" status: 404 len: 111 microversion: 2.1 time: 0.058948 May 19 21:32:20.536601 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 10/21] 10.222.0.65 () {58 vars in 1250 bytes} [Thu May 19 21:32:20 2022] GET /compute/v2.1/os-snapshots/e050bad4-610d-4f8b-8769-41947fec09d6 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 21:32:20.551778 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-6e1d84bf-9906-4e48-b182-d7d6fced3584 tempest-VolumesSnapshotsTestJSON-1217911260 tempest-VolumesSnapshotsTestJSON-1217911260-project] Calling method '.version_select at 0x7fe369f02a60>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:32:20.698493 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-6e1d84bf-9906-4e48-b182-d7d6fced3584 tempest-VolumesSnapshotsTestJSON-1217911260 tempest-VolumesSnapshotsTestJSON-1217911260-project] 10.222.0.65 "DELETE /compute/v2.1/os-volumes/a33c1402-4ed3-49fa-beea-057029c93649" status: 202 len: 0 microversion: 2.1 time: 0.156378 May 19 21:32:20.699334 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 11/22] 10.222.0.65 () {58 vars in 1247 bytes} [Thu May 19 21:32:20 2022] DELETE /compute/v2.1/os-volumes/a33c1402-4ed3-49fa-beea-057029c93649 => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 21:32:20.709986 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-dbdf97b1-a851-498a-8b28-cf0c2ae5450b tempest-VolumesSnapshotsTestJSON-1217911260 tempest-VolumesSnapshotsTestJSON-1217911260-project] Calling method '.version_select at 0x7fe368328430>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:32:20.828754 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-dbdf97b1-a851-498a-8b28-cf0c2ae5450b tempest-VolumesSnapshotsTestJSON-1217911260 tempest-VolumesSnapshotsTestJSON-1217911260-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/a33c1402-4ed3-49fa-beea-057029c93649" status: 200 len: 345 microversion: 2.1 time: 0.124274 May 19 21:32:20.829714 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 12/23] 10.222.0.65 () {58 vars in 1244 bytes} [Thu May 19 21:32:20 2022] GET /compute/v2.1/os-volumes/a33c1402-4ed3-49fa-beea-057029c93649 => generated 345 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 21:32:20.933087 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-a075431c-be03-40fa-b608-07fb676ab9fa tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:32:20.934292 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-a075431c-be03-40fa-b608-07fb676ab9fa tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] [instance: c31d034b-2cf3-4518-8e50-8beda1897c20] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:32:20.957855 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a075431c-be03-40fa-b608-07fb676ab9fa tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:32:20.958666 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a075431c-be03-40fa-b608-07fb676ab9fa tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:32:20.960780 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a075431c-be03-40fa-b608-07fb676ab9fa tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:32:20.962336 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a075431c-be03-40fa-b608-07fb676ab9fa tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:32:22.905005 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell0:SELECT=2 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:32:22.984709 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.virt.hardware [None req-06be1508-c890-4075-ad38-7c3655bb3230 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Flavor limits 0:0:0 {{(pid=124349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 21:32:22.985949 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.virt.hardware [None req-06be1508-c890-4075-ad38-7c3655bb3230 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Image limits 0:0:0 {{(pid=124349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 21:32:22.987372 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.virt.hardware [None req-06be1508-c890-4075-ad38-7c3655bb3230 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Flavor pref 0:0:0 {{(pid=124349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 21:32:22.988068 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.virt.hardware [None req-06be1508-c890-4075-ad38-7c3655bb3230 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Image pref 0:0:0 {{(pid=124349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 21:32:22.991465 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.virt.hardware [None req-06be1508-c890-4075-ad38-7c3655bb3230 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 21:32:23.043017 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-06be1508-c890-4075-ad38-7c3655bb3230 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:32:23.043935 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-06be1508-c890-4075-ad38-7c3655bb3230 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:32:23.051119 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-06be1508-c890-4075-ad38-7c3655bb3230 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:32:23.056593 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-06be1508-c890-4075-ad38-7c3655bb3230 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:32:23.203319 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.quota [None req-06be1508-c890-4075-ad38-7c3655bb3230 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Getting quotas for project 985c62c1f3c54f568abdac37360ab457. Resources: {'ram', 'cores', 'instances'} {{(pid=124349) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 21:32:23.245763 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.quota [None req-06be1508-c890-4075-ad38-7c3655bb3230 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Getting quotas for user 1589968f375946a38e82ec484afc837f and project 985c62c1f3c54f568abdac37360ab457. Resources: {'ram', 'cores', 'instances'} {{(pid=124349) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 21:32:23.304405 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-06be1508-c890-4075-ad38-7c3655bb3230 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Going to run 1 instances... {{(pid=124349) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 21:32:23.312040 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-06be1508-c890-4075-ad38-7c3655bb3230 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: a18b9269-6ed1-4af1-a0da-8260f38fbf39] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a874457a-f8a8-46f6-bdcc-1fa632a0d3c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124349) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 21:32:23.616674 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-06be1508-c890-4075-ad38-7c3655bb3230 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 5.027139 May 19 21:32:23.618177 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 12/24] 10.222.0.65 () {60 vars in 1146 bytes} [Thu May 19 21:32:18 2022] POST /compute/v2.1/servers => generated 383 bytes in 5029 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 21:32:23.630639 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-18b0ea63-e704-426e-b854-0aa6fe64c919 tempest-VolumesSnapshotsTestJSON-1217911260 tempest-VolumesSnapshotsTestJSON-1217911260-project] Calling method '.version_select at 0x7fe369440700>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:32:23.750101 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.wsgi [None req-18b0ea63-e704-426e-b854-0aa6fe64c919 tempest-VolumesSnapshotsTestJSON-1217911260 tempest-VolumesSnapshotsTestJSON-1217911260-project] HTTP exception thrown: Volume a33c1402-4ed3-49fa-beea-057029c93649 could not be found. May 19 21:32:23.755568 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-18b0ea63-e704-426e-b854-0aa6fe64c919 tempest-VolumesSnapshotsTestJSON-1217911260 tempest-VolumesSnapshotsTestJSON-1217911260-project] Request method failure captured: May 19 21:32:23.755568 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: request: GET /compute/v2.1/os-volumes/a33c1402-4ed3-49fa-beea-057029c93649 HTTP/1.1 May 19 21:32:23.755568 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Accept: application/json May 19 21:32:23.755568 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Accept-Encoding: identity May 19 21:32:23.755568 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Connection: close May 19 21:32:23.755568 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Content-Length: 0 May 19 21:32:23.755568 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Content-Type: application/json May 19 21:32:23.755568 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Host: 10.222.0.65 May 19 21:32:23.755568 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Openstack-System-Scope: None May 19 21:32:23.755568 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: User-Agent: python-urllib3/1.26.9 May 19 21:32:23.755568 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Auth-Token: gAAAAABihrdXevjzh-M3dGxErq9MALouYasLzDKQIVT1qaxCktthDQ29eyTRppLVMsQCDfaxI03wIB1J90uaaFcr-iG1glm3EtKbfJTYsFviXzOfU7f2IlOL_uaEhbKBJ11JKTq-s8-xSjbvP7yCb__45Q42jcJRzWFz7Xk9YhwL3N1hMD1sw84 May 19 21:32:23.755568 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Domain-Id: None May 19 21:32:23.755568 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Domain-Name: None May 19 21:32:23.755568 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Identity-Status: Confirmed May 19 21:32:23.755568 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Is-Admin-Project: True May 19 21:32:23.755568 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Project-Domain-Id: default May 19 21:32:23.755568 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Project-Domain-Name: Default May 19 21:32:23.755568 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Project-Id: 8afcda833ca0433e95d6f9de6fc0df21 May 19 21:32:23.755568 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1217911260 May 19 21:32:23.755568 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Role: reader,member May 19 21:32:23.755568 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Roles: reader,member May 19 21:32:23.756980 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/8afcda833ca0433e95d6f9de6fc0df21"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/8afcda833ca0433e95d6f9de6fc0df21"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_8afcda833ca0433e95d6f9de6fc0df21"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/8afcda833ca0433e95d6f9de6fc0df21"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}] May 19 21:32:23.756980 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1217911260 May 19 21:32:23.756980 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Tenant-Id: 8afcda833ca0433e95d6f9de6fc0df21 May 19 21:32:23.756980 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1217911260 May 19 21:32:23.756980 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-User: tempest-VolumesSnapshotsTestJSON-1217911260-project May 19 21:32:23.756980 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-User-Domain-Id: default May 19 21:32:23.756980 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-User-Domain-Name: Default May 19 21:32:23.756980 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-User-Id: 04d032c7e7fb4eaaa9fdf3e92d7e28b8 May 19 21:32:23.756980 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1217911260-project May 19 21:32:23.756980 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: method: May 19 21:32:23.756980 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: exception: Volume a33c1402-4ed3-49fa-beea-057029c93649 could not be found. May 19 21:32:23.756980 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: action_args: {'id': 'a33c1402-4ed3-49fa-beea-057029c93649'} May 19 21:32:23.756980 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 21:32:23.757906 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:32:23.757906 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 19 21:32:23.757906 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 19 21:32:23.757906 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 19 21:32:23.757906 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi item = cinderclient( May 19 21:32:23.757906 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 19 21:32:23.757906 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 19 21:32:23.757906 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 19 21:32:23.757906 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 19 21:32:23.757906 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 19 21:32:23.757906 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 19 21:32:23.757906 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 21:32:23.757906 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 21:32:23.757906 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 21:32:23.757906 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 21:32:23.757906 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a33c1402-4ed3-49fa-beea-057029c93649 could not be found. (HTTP 404) (Request-ID: req-a1e2de71-5c1e-4809-a46e-95abee56f1a2) May 19 21:32:23.757906 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:32:23.757906 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 21:32:23.757906 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:32:23.759572 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:32:23.759572 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 19 21:32:23.759572 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 19 21:32:23.759572 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 19 21:32:23.759572 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 19 21:32:23.759572 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 19 21:32:23.759572 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 19 21:32:23.759572 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 19 21:32:23.759572 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 19 21:32:23.759572 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 19 21:32:23.759572 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 19 21:32:23.759572 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 19 21:32:23.759572 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi item = cinderclient( May 19 21:32:23.759572 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 19 21:32:23.759572 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 19 21:32:23.759572 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 19 21:32:23.759572 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 19 21:32:23.759572 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 19 21:32:23.759572 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 19 21:32:23.760856 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 21:32:23.760856 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 21:32:23.760856 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 21:32:23.760856 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 21:32:23.760856 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a33c1402-4ed3-49fa-beea-057029c93649 could not be found. May 19 21:32:23.760856 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:32:23.760856 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 21:32:23.760856 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:32:23.760856 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:32:23.760856 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 21:32:23.760856 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 21:32:23.760856 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 21:32:23.760856 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 21:32:23.760856 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 21:32:23.760856 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 21:32:23.760856 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 21:32:23.760856 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 21:32:23.760856 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 19 21:32:23.760856 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 21:32:23.762136 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a33c1402-4ed3-49fa-beea-057029c93649 could not be found. May 19 21:32:23.762136 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:32:23.762136 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 21:32:23.762136 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:32:23.762136 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:32:23.762136 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 21:32:23.762136 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 21:32:23.762136 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 21:32:23.762136 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 21:32:23.762136 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a33c1402-4ed3-49fa-beea-057029c93649 could not be found. May 19 21:32:23.762136 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:32:23.762136 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-18b0ea63-e704-426e-b854-0aa6fe64c919 tempest-VolumesSnapshotsTestJSON-1217911260 tempest-VolumesSnapshotsTestJSON-1217911260-project] Returning 404 to user: Volume a33c1402-4ed3-49fa-beea-057029c93649 could not be found. {{(pid=124349) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 21:32:23.764618 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-18b0ea63-e704-426e-b854-0aa6fe64c919 tempest-VolumesSnapshotsTestJSON-1217911260 tempest-VolumesSnapshotsTestJSON-1217911260-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/a33c1402-4ed3-49fa-beea-057029c93649" status: 404 len: 109 microversion: 2.1 time: 0.144660 May 19 21:32:23.773824 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 13/25] 10.222.0.65 () {58 vars in 1244 bytes} [Thu May 19 21:32:23 2022] GET /compute/v2.1/os-volumes/a33c1402-4ed3-49fa-beea-057029c93649 => generated 109 bytes in 155 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 21:32:23.785763 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-a075431c-be03-40fa-b608-07fb676ab9fa tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc570204a2bb4889889a67850dd1d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6166dc89ce0545c1bbb8adb947034e79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:32:23.788349 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-e8fbacd3-a9a9-46ed-b231-b01b782bf750 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:32:23.796141 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-a075431c-be03-40fa-b608-07fb676ab9fa tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] 10.222.0.65 "GET /compute/v2.1/servers/c31d034b-2cf3-4518-8e50-8beda1897c20" status: 200 len: 1314 microversion: 2.1 time: 2.868362 May 19 21:32:23.800780 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-e8fbacd3-a9a9-46ed-b231-b01b782bf750 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: a18b9269-6ed1-4af1-a0da-8260f38fbf39] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:32:23.809345 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 13/26] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:32:20 2022] GET /compute/v2.1/servers/c31d034b-2cf3-4518-8e50-8beda1897c20 => generated 1314 bytes in 2882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:32:23.815386 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-91641d85-8a11-43b3-9aee-a6af3b270c38 tempest-VolumesSnapshotsTestJSON-1217911260 tempest-VolumesSnapshotsTestJSON-1217911260-project] Calling method '.version_select at 0x7fe36829aaf0>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:32:23.910958 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.wsgi [None req-91641d85-8a11-43b3-9aee-a6af3b270c38 tempest-VolumesSnapshotsTestJSON-1217911260 tempest-VolumesSnapshotsTestJSON-1217911260-project] HTTP exception thrown: Volume a33c1402-4ed3-49fa-beea-057029c93649 could not be found. May 19 21:32:23.914738 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-91641d85-8a11-43b3-9aee-a6af3b270c38 tempest-VolumesSnapshotsTestJSON-1217911260 tempest-VolumesSnapshotsTestJSON-1217911260-project] Request method failure captured: May 19 21:32:23.914738 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: request: DELETE /compute/v2.1/os-volumes/a33c1402-4ed3-49fa-beea-057029c93649 HTTP/1.1 May 19 21:32:23.914738 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Accept: application/json May 19 21:32:23.914738 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Accept-Encoding: identity May 19 21:32:23.914738 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Connection: close May 19 21:32:23.914738 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Content-Length: 0 May 19 21:32:23.914738 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Content-Type: application/json May 19 21:32:23.914738 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Host: 10.222.0.65 May 19 21:32:23.914738 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Openstack-System-Scope: None May 19 21:32:23.914738 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: User-Agent: python-urllib3/1.26.9 May 19 21:32:23.914738 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Auth-Token: gAAAAABihrdXevjzh-M3dGxErq9MALouYasLzDKQIVT1qaxCktthDQ29eyTRppLVMsQCDfaxI03wIB1J90uaaFcr-iG1glm3EtKbfJTYsFviXzOfU7f2IlOL_uaEhbKBJ11JKTq-s8-xSjbvP7yCb__45Q42jcJRzWFz7Xk9YhwL3N1hMD1sw84 May 19 21:32:23.914738 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Domain-Id: None May 19 21:32:23.914738 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Domain-Name: None May 19 21:32:23.914738 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Identity-Status: Confirmed May 19 21:32:23.914738 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Is-Admin-Project: True May 19 21:32:23.914738 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Project-Domain-Id: default May 19 21:32:23.914738 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Project-Domain-Name: Default May 19 21:32:23.914738 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Project-Id: 8afcda833ca0433e95d6f9de6fc0df21 May 19 21:32:23.914738 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1217911260 May 19 21:32:23.914738 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Role: reader,member May 19 21:32:23.914738 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Roles: reader,member May 19 21:32:23.916608 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/8afcda833ca0433e95d6f9de6fc0df21"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/8afcda833ca0433e95d6f9de6fc0df21"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_8afcda833ca0433e95d6f9de6fc0df21"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/8afcda833ca0433e95d6f9de6fc0df21"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}] May 19 21:32:23.916608 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1217911260 May 19 21:32:23.916608 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Tenant-Id: 8afcda833ca0433e95d6f9de6fc0df21 May 19 21:32:23.916608 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1217911260 May 19 21:32:23.916608 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-User: tempest-VolumesSnapshotsTestJSON-1217911260-project May 19 21:32:23.916608 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-User-Domain-Id: default May 19 21:32:23.916608 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-User-Domain-Name: Default May 19 21:32:23.916608 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-User-Id: 04d032c7e7fb4eaaa9fdf3e92d7e28b8 May 19 21:32:23.916608 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1217911260-project May 19 21:32:23.916608 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: method: May 19 21:32:23.916608 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: exception: Volume a33c1402-4ed3-49fa-beea-057029c93649 could not be found. May 19 21:32:23.916608 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: action_args: {'id': 'a33c1402-4ed3-49fa-beea-057029c93649'} May 19 21:32:23.916608 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 21:32:23.917372 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:32:23.917372 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 19 21:32:23.917372 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 19 21:32:23.917372 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 19 21:32:23.917372 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 19 21:32:23.917372 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 19 21:32:23.917372 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 19 21:32:23.917372 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 19 21:32:23.917372 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 19 21:32:23.917372 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 19 21:32:23.917372 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 19 21:32:23.917372 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 21:32:23.917372 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 21:32:23.917372 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 21:32:23.917372 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 21:32:23.917372 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a33c1402-4ed3-49fa-beea-057029c93649 could not be found. (HTTP 404) (Request-ID: req-8752aafa-80a0-4eb3-8c4b-025635c81731) May 19 21:32:23.917372 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi May 19 21:32:23.917372 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 21:32:23.917372 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi May 19 21:32:23.918720 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:32:23.918720 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 19 21:32:23.918720 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 19 21:32:23.918720 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 19 21:32:23.918720 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 19 21:32:23.918720 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 19 21:32:23.918720 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 19 21:32:23.918720 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 19 21:32:23.918720 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 19 21:32:23.918720 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 19 21:32:23.918720 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 19 21:32:23.918720 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 19 21:32:23.918720 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 19 21:32:23.918720 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 19 21:32:23.918720 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 19 21:32:23.918720 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 19 21:32:23.918720 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 19 21:32:23.918720 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 19 21:32:23.918720 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 19 21:32:23.919815 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 21:32:23.919815 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 21:32:23.919815 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 21:32:23.919815 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 21:32:23.919815 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a33c1402-4ed3-49fa-beea-057029c93649 could not be found. May 19 21:32:23.919815 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi May 19 21:32:23.919815 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 21:32:23.919815 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi May 19 21:32:23.919815 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:32:23.919815 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 21:32:23.919815 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 21:32:23.919815 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 21:32:23.919815 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 21:32:23.919815 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 21:32:23.919815 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 21:32:23.919815 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 21:32:23.919815 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 21:32:23.919815 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 19 21:32:23.919815 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 21:32:23.922041 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a33c1402-4ed3-49fa-beea-057029c93649 could not be found. May 19 21:32:23.922041 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi May 19 21:32:23.922041 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 21:32:23.922041 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi May 19 21:32:23.922041 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:32:23.922041 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 21:32:23.922041 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 21:32:23.922041 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 21:32:23.922041 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 21:32:23.922041 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a33c1402-4ed3-49fa-beea-057029c93649 could not be found. May 19 21:32:23.922041 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi May 19 21:32:23.924083 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-91641d85-8a11-43b3-9aee-a6af3b270c38 tempest-VolumesSnapshotsTestJSON-1217911260 tempest-VolumesSnapshotsTestJSON-1217911260-project] Returning 404 to user: Volume a33c1402-4ed3-49fa-beea-057029c93649 could not be found. {{(pid=124350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 21:32:23.925402 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-91641d85-8a11-43b3-9aee-a6af3b270c38 tempest-VolumesSnapshotsTestJSON-1217911260 tempest-VolumesSnapshotsTestJSON-1217911260-project] 10.222.0.65 "DELETE /compute/v2.1/os-volumes/a33c1402-4ed3-49fa-beea-057029c93649" status: 404 len: 109 microversion: 2.1 time: 0.115343 May 19 21:32:23.926276 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 14/27] 10.222.0.65 () {58 vars in 1247 bytes} [Thu May 19 21:32:23 2022] DELETE /compute/v2.1/os-volumes/a33c1402-4ed3-49fa-beea-057029c93649 => generated 109 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 21:32:23.935771 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-25b42de2-d5cd-44e1-bfce-3d9188ccf30b tempest-VolumesSnapshotsTestJSON-1217911260 tempest-VolumesSnapshotsTestJSON-1217911260-project] Calling method '.version_select at 0x7fe3682a1820>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:32:24.001745 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.wsgi [None req-25b42de2-d5cd-44e1-bfce-3d9188ccf30b tempest-VolumesSnapshotsTestJSON-1217911260 tempest-VolumesSnapshotsTestJSON-1217911260-project] HTTP exception thrown: Volume a33c1402-4ed3-49fa-beea-057029c93649 could not be found. May 19 21:32:24.004335 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-25b42de2-d5cd-44e1-bfce-3d9188ccf30b tempest-VolumesSnapshotsTestJSON-1217911260 tempest-VolumesSnapshotsTestJSON-1217911260-project] Request method failure captured: May 19 21:32:24.004335 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: request: GET /compute/v2.1/os-volumes/a33c1402-4ed3-49fa-beea-057029c93649 HTTP/1.1 May 19 21:32:24.004335 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Accept: application/json May 19 21:32:24.004335 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Accept-Encoding: identity May 19 21:32:24.004335 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Connection: close May 19 21:32:24.004335 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Content-Length: 0 May 19 21:32:24.004335 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Content-Type: application/json May 19 21:32:24.004335 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Host: 10.222.0.65 May 19 21:32:24.004335 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Openstack-System-Scope: None May 19 21:32:24.004335 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: User-Agent: python-urllib3/1.26.9 May 19 21:32:24.004335 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Auth-Token: gAAAAABihrdXevjzh-M3dGxErq9MALouYasLzDKQIVT1qaxCktthDQ29eyTRppLVMsQCDfaxI03wIB1J90uaaFcr-iG1glm3EtKbfJTYsFviXzOfU7f2IlOL_uaEhbKBJ11JKTq-s8-xSjbvP7yCb__45Q42jcJRzWFz7Xk9YhwL3N1hMD1sw84 May 19 21:32:24.004335 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Domain-Id: None May 19 21:32:24.004335 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Domain-Name: None May 19 21:32:24.004335 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Identity-Status: Confirmed May 19 21:32:24.004335 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Is-Admin-Project: True May 19 21:32:24.004335 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Project-Domain-Id: default May 19 21:32:24.004335 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Project-Domain-Name: Default May 19 21:32:24.004335 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Project-Id: 8afcda833ca0433e95d6f9de6fc0df21 May 19 21:32:24.004335 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1217911260 May 19 21:32:24.004335 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Role: reader,member May 19 21:32:24.004335 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Roles: reader,member May 19 21:32:24.005859 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/8afcda833ca0433e95d6f9de6fc0df21"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/8afcda833ca0433e95d6f9de6fc0df21"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_8afcda833ca0433e95d6f9de6fc0df21"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/8afcda833ca0433e95d6f9de6fc0df21"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}] May 19 21:32:24.005859 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1217911260 May 19 21:32:24.005859 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Tenant-Id: 8afcda833ca0433e95d6f9de6fc0df21 May 19 21:32:24.005859 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1217911260 May 19 21:32:24.005859 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-User: tempest-VolumesSnapshotsTestJSON-1217911260-project May 19 21:32:24.005859 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-User-Domain-Id: default May 19 21:32:24.005859 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-User-Domain-Name: Default May 19 21:32:24.005859 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-User-Id: 04d032c7e7fb4eaaa9fdf3e92d7e28b8 May 19 21:32:24.005859 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1217911260-project May 19 21:32:24.005859 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: method: May 19 21:32:24.005859 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: exception: Volume a33c1402-4ed3-49fa-beea-057029c93649 could not be found. May 19 21:32:24.005859 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: action_args: {'id': 'a33c1402-4ed3-49fa-beea-057029c93649'} May 19 21:32:24.005859 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 21:32:24.007382 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:32:24.007382 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 19 21:32:24.007382 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 19 21:32:24.007382 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 19 21:32:24.007382 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi item = cinderclient( May 19 21:32:24.007382 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 19 21:32:24.007382 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 19 21:32:24.007382 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 19 21:32:24.007382 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 19 21:32:24.007382 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 19 21:32:24.007382 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 19 21:32:24.007382 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 21:32:24.007382 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 21:32:24.007382 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 21:32:24.007382 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 21:32:24.007382 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a33c1402-4ed3-49fa-beea-057029c93649 could not be found. (HTTP 404) (Request-ID: req-f82d4490-64aa-45fb-9e98-40dbd2661200) May 19 21:32:24.007382 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi May 19 21:32:24.007382 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 21:32:24.007382 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi May 19 21:32:24.008954 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:32:24.008954 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 19 21:32:24.008954 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 19 21:32:24.008954 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 19 21:32:24.008954 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 19 21:32:24.008954 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 19 21:32:24.008954 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 19 21:32:24.008954 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 19 21:32:24.008954 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 19 21:32:24.008954 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 19 21:32:24.008954 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 19 21:32:24.008954 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 19 21:32:24.008954 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi item = cinderclient( May 19 21:32:24.008954 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 19 21:32:24.008954 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 19 21:32:24.008954 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 19 21:32:24.008954 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 19 21:32:24.008954 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 19 21:32:24.008954 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 19 21:32:24.010603 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 21:32:24.010603 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 21:32:24.010603 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 21:32:24.010603 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 21:32:24.010603 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a33c1402-4ed3-49fa-beea-057029c93649 could not be found. May 19 21:32:24.010603 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi May 19 21:32:24.010603 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 21:32:24.010603 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi May 19 21:32:24.010603 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:32:24.010603 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 21:32:24.010603 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 21:32:24.010603 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 21:32:24.010603 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 21:32:24.010603 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 21:32:24.010603 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 21:32:24.010603 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 21:32:24.010603 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 21:32:24.010603 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 19 21:32:24.010603 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 21:32:24.011984 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a33c1402-4ed3-49fa-beea-057029c93649 could not be found. May 19 21:32:24.011984 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi May 19 21:32:24.011984 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 21:32:24.011984 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi May 19 21:32:24.011984 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:32:24.011984 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 21:32:24.011984 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 21:32:24.011984 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 21:32:24.011984 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 21:32:24.011984 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a33c1402-4ed3-49fa-beea-057029c93649 could not be found. May 19 21:32:24.011984 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi May 19 21:32:24.013529 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-25b42de2-d5cd-44e1-bfce-3d9188ccf30b tempest-VolumesSnapshotsTestJSON-1217911260 tempest-VolumesSnapshotsTestJSON-1217911260-project] Returning 404 to user: Volume a33c1402-4ed3-49fa-beea-057029c93649 could not be found. {{(pid=124350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 21:32:24.025765 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-25b42de2-d5cd-44e1-bfce-3d9188ccf30b tempest-VolumesSnapshotsTestJSON-1217911260 tempest-VolumesSnapshotsTestJSON-1217911260-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/a33c1402-4ed3-49fa-beea-057029c93649" status: 404 len: 109 microversion: 2.1 time: 0.094512 May 19 21:32:24.030742 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 15/28] 10.222.0.65 () {58 vars in 1244 bytes} [Thu May 19 21:32:23 2022] GET /compute/v2.1/os-volumes/a33c1402-4ed3-49fa-beea-057029c93649 => generated 109 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 21:32:24.381744 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-e8fbacd3-a9a9-46ed-b231-b01b782bf750 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1589968f375946a38e82ec484afc837f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c62c1f3c54f568abdac37360ab457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:32:24.424101 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-e8fbacd3-a9a9-46ed-b231-b01b782bf750 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "GET /compute/v2.1/servers/a18b9269-6ed1-4af1-a0da-8260f38fbf39" status: 200 len: 1222 microversion: 2.1 time: 0.639319 May 19 21:32:24.433674 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 14/29] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:32:23 2022] GET /compute/v2.1/servers/a18b9269-6ed1-4af1-a0da-8260f38fbf39 => generated 1222 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:32:24.817603 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-d02b02d5-0728-41bb-a1ff-8fc8eb82c34e tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:32:24.818439 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-d02b02d5-0728-41bb-a1ff-8fc8eb82c34e tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] [instance: c31d034b-2cf3-4518-8e50-8beda1897c20] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:32:24.928659 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d02b02d5-0728-41bb-a1ff-8fc8eb82c34e tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:32:24.929255 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d02b02d5-0728-41bb-a1ff-8fc8eb82c34e tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:32:24.942662 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d02b02d5-0728-41bb-a1ff-8fc8eb82c34e tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:32:24.949423 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d02b02d5-0728-41bb-a1ff-8fc8eb82c34e tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:32:25.373809 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell0:SELECT=10 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:32:26.165937 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-d02b02d5-0728-41bb-a1ff-8fc8eb82c34e tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc570204a2bb4889889a67850dd1d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6166dc89ce0545c1bbb8adb947034e79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:32:26.176759 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-d02b02d5-0728-41bb-a1ff-8fc8eb82c34e tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] 10.222.0.65 "GET /compute/v2.1/servers/c31d034b-2cf3-4518-8e50-8beda1897c20" status: 200 len: 1314 microversion: 2.1 time: 1.365779 May 19 21:32:26.211826 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 16/30] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:32:24 2022] GET /compute/v2.1/servers/c31d034b-2cf3-4518-8e50-8beda1897c20 => generated 1314 bytes in 1401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 21:32:26.220419 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-a17ef61d-270b-49fe-9acb-54709adf0fa2 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1328616269", "imageRef": "a874457a-f8a8-46f6-bdcc-1fa632a0d3c0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:32:26.393894 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.network.neutron [None req-a17ef61d-270b-49fe-9acb-54709adf0fa2 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] validate_networks() for [('c14ce0dd-3e64-476b-9ef2-fbfc9abe672b', None, None, None, None, None)] {{(pid=124350) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 19 21:32:26.586640 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-3486d3c7-5a77-4659-9b83-e4716d32ecae tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Action: 'create', calling method: .version_select at 0x7fe36839b5e0>, body: {"keypair": {"name": "tempest-keypair-1164290557", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOAxVTNzIAbX6u1MW77GmzwkhjB7Bv7qLMzF9QZyDiuwecEoo5L3nvbpxKFWArs3Pv/4tK3Wv4lUNkXgF4fV5/xVWb7zcxd/MUtRyBipeVsTkDWXV9KW+qroJUfAJ1o8LQ=="}} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:32:26.712845 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.quota [None req-3486d3c7-5a77-4659-9b83-e4716d32ecae tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Getting quotas for project 92434c51e27a405aaa89a70a660f6d91. Resources: {'key_pairs'} {{(pid=124349) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 21:32:26.741894 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.quota [None req-3486d3c7-5a77-4659-9b83-e4716d32ecae tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Getting quotas for user f47e7f746a014cb0a35390e7e0ce435d and project 92434c51e27a405aaa89a70a660f6d91. Resources: {'key_pairs'} {{(pid=124349) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 21:32:26.860813 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-3486d3c7-5a77-4659-9b83-e4716d32ecae tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 1.857827 May 19 21:32:26.862188 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 15/31] 10.222.0.65 () {62 vars in 1199 bytes} [Thu May 19 21:32:25 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 1860 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 19 21:32:27.223483 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-01a72d10-cacd-4207-949b-c2cdc31adf00 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:32:27.225159 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-01a72d10-cacd-4207-949b-c2cdc31adf00 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] [instance: c31d034b-2cf3-4518-8e50-8beda1897c20] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:32:27.254788 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-01a72d10-cacd-4207-949b-c2cdc31adf00 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:32:27.266374 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-01a72d10-cacd-4207-949b-c2cdc31adf00 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:32:27.286726 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-01a72d10-cacd-4207-949b-c2cdc31adf00 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:32:27.291464 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-01a72d10-cacd-4207-949b-c2cdc31adf00 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:32:29.838219 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-01a72d10-cacd-4207-949b-c2cdc31adf00 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc570204a2bb4889889a67850dd1d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6166dc89ce0545c1bbb8adb947034e79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:32:29.934419 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-01a72d10-cacd-4207-949b-c2cdc31adf00 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] 10.222.0.65 "GET /compute/v2.1/servers/c31d034b-2cf3-4518-8e50-8beda1897c20" status: 200 len: 1314 microversion: 2.1 time: 2.720652 May 19 21:32:29.941860 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 16/32] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:32:27 2022] GET /compute/v2.1/servers/c31d034b-2cf3-4518-8e50-8beda1897c20 => generated 1314 bytes in 2729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 21:32:30.959829 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-be8eb749-1264-45b0-8e8f-45ade7c04f37 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:32:30.960589 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-be8eb749-1264-45b0-8e8f-45ade7c04f37 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] [instance: c31d034b-2cf3-4518-8e50-8beda1897c20] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:32:30.998658 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-be8eb749-1264-45b0-8e8f-45ade7c04f37 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:32:31.006854 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-be8eb749-1264-45b0-8e8f-45ade7c04f37 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:32:31.011896 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-be8eb749-1264-45b0-8e8f-45ade7c04f37 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:32:31.013759 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-be8eb749-1264-45b0-8e8f-45ade7c04f37 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:32:31.489238 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.virt.hardware [None req-a17ef61d-270b-49fe-9acb-54709adf0fa2 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Flavor limits 0:0:0 {{(pid=124350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 21:32:31.490515 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.virt.hardware [None req-a17ef61d-270b-49fe-9acb-54709adf0fa2 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Image limits 0:0:0 {{(pid=124350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 21:32:31.491148 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.virt.hardware [None req-a17ef61d-270b-49fe-9acb-54709adf0fa2 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Flavor pref 0:0:0 {{(pid=124350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 21:32:31.491705 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.virt.hardware [None req-a17ef61d-270b-49fe-9acb-54709adf0fa2 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Image pref 0:0:0 {{(pid=124350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 21:32:31.492265 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.virt.hardware [None req-a17ef61d-270b-49fe-9acb-54709adf0fa2 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 21:32:31.523456 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a17ef61d-270b-49fe-9acb-54709adf0fa2 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:32:31.523951 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a17ef61d-270b-49fe-9acb-54709adf0fa2 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:32:31.524831 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a17ef61d-270b-49fe-9acb-54709adf0fa2 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:32:31.525268 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a17ef61d-270b-49fe-9acb-54709adf0fa2 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:32:31.601523 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.quota [None req-a17ef61d-270b-49fe-9acb-54709adf0fa2 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Getting quotas for project 985c62c1f3c54f568abdac37360ab457. Resources: {'ram', 'cores', 'instances'} {{(pid=124350) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 21:32:31.631568 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.quota [None req-a17ef61d-270b-49fe-9acb-54709adf0fa2 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Getting quotas for user 1589968f375946a38e82ec484afc837f and project 985c62c1f3c54f568abdac37360ab457. Resources: {'ram', 'cores', 'instances'} {{(pid=124350) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 21:32:31.688908 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-a17ef61d-270b-49fe-9acb-54709adf0fa2 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Going to run 1 instances... {{(pid=124350) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 21:32:31.696888 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-a17ef61d-270b-49fe-9acb-54709adf0fa2 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a874457a-f8a8-46f6-bdcc-1fa632a0d3c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124350) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 21:32:31.886615 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-a17ef61d-270b-49fe-9acb-54709adf0fa2 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 5.671890 May 19 21:32:31.888765 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 17/33] 10.222.0.65 () {60 vars in 1146 bytes} [Thu May 19 21:32:26 2022] POST /compute/v2.1/servers => generated 383 bytes in 5676 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 21:32:31.917839 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-715d2f9e-556d-41c7-aa8b-d10652256bf6 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:32:31.918529 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-715d2f9e-556d-41c7-aa8b-d10652256bf6 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:32:32.449285 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-715d2f9e-556d-41c7-aa8b-d10652256bf6 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1589968f375946a38e82ec484afc837f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c62c1f3c54f568abdac37360ab457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:32:32.460572 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-715d2f9e-556d-41c7-aa8b-d10652256bf6 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "GET /compute/v2.1/servers/e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7" status: 200 len: 1222 microversion: 2.1 time: 0.559334 May 19 21:32:32.490047 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 18/34] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:32:31 2022] GET /compute/v2.1/servers/e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7 => generated 1222 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:32:32.666743 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-be8eb749-1264-45b0-8e8f-45ade7c04f37 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc570204a2bb4889889a67850dd1d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6166dc89ce0545c1bbb8adb947034e79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:32:32.705639 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-be8eb749-1264-45b0-8e8f-45ade7c04f37 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] 10.222.0.65 "GET /compute/v2.1/servers/c31d034b-2cf3-4518-8e50-8beda1897c20" status: 200 len: 1314 microversion: 2.1 time: 1.750219 May 19 21:32:32.706441 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 17/35] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:32:30 2022] GET /compute/v2.1/servers/c31d034b-2cf3-4518-8e50-8beda1897c20 => generated 1314 bytes in 1752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 21:32:33.489332 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-d49621bf-fe05-4aad-83a9-e4134ec5a824 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:32:33.490461 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-d49621bf-fe05-4aad-83a9-e4134ec5a824 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:32:33.524552 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d49621bf-fe05-4aad-83a9-e4134ec5a824 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:32:33.534611 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d49621bf-fe05-4aad-83a9-e4134ec5a824 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:32:33.538286 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d49621bf-fe05-4aad-83a9-e4134ec5a824 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:32:33.539434 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d49621bf-fe05-4aad-83a9-e4134ec5a824 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:32:33.724179 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-6dff0b82-03fd-49d5-9435-863bd14e6f63 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:32:33.724800 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-6dff0b82-03fd-49d5-9435-863bd14e6f63 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] [instance: c31d034b-2cf3-4518-8e50-8beda1897c20] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:32:33.727090 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_cell0:SELECT=2 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:32:33.757635 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-6dff0b82-03fd-49d5-9435-863bd14e6f63 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:32:33.760986 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-6dff0b82-03fd-49d5-9435-863bd14e6f63 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:32:33.764054 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-6dff0b82-03fd-49d5-9435-863bd14e6f63 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:32:33.774980 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-6dff0b82-03fd-49d5-9435-863bd14e6f63 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:32:34.110576 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-d49621bf-fe05-4aad-83a9-e4134ec5a824 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1589968f375946a38e82ec484afc837f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c62c1f3c54f568abdac37360ab457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:32:34.127909 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-d49621bf-fe05-4aad-83a9-e4134ec5a824 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "GET /compute/v2.1/servers/e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7" status: 200 len: 1226 microversion: 2.1 time: 0.645131 May 19 21:32:34.132705 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 19/36] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:32:33 2022] GET /compute/v2.1/servers/e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7 => generated 1226 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:32:35.022603 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-6dff0b82-03fd-49d5-9435-863bd14e6f63 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc570204a2bb4889889a67850dd1d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6166dc89ce0545c1bbb8adb947034e79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:32:35.031882 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-6dff0b82-03fd-49d5-9435-863bd14e6f63 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] 10.222.0.65 "GET /compute/v2.1/servers/c31d034b-2cf3-4518-8e50-8beda1897c20" status: 200 len: 1314 microversion: 2.1 time: 1.312246 May 19 21:32:35.037572 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 18/37] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:32:33 2022] GET /compute/v2.1/servers/c31d034b-2cf3-4518-8e50-8beda1897c20 => generated 1314 bytes in 1318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 21:32:35.148087 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-c73b948d-e9da-4a50-8520-9a70ce40878d tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:32:35.150232 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-c73b948d-e9da-4a50-8520-9a70ce40878d tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:32:35.170939 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c73b948d-e9da-4a50-8520-9a70ce40878d tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:32:35.172600 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c73b948d-e9da-4a50-8520-9a70ce40878d tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:32:35.176426 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c73b948d-e9da-4a50-8520-9a70ce40878d tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:32:35.179370 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c73b948d-e9da-4a50-8520-9a70ce40878d tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:32:35.734834 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-c73b948d-e9da-4a50-8520-9a70ce40878d tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1589968f375946a38e82ec484afc837f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c62c1f3c54f568abdac37360ab457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:32:35.746277 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-c73b948d-e9da-4a50-8520-9a70ce40878d tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "GET /compute/v2.1/servers/e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7" status: 200 len: 1280 microversion: 2.1 time: 0.603795 May 19 21:32:35.750035 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 20/38] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:32:35 2022] GET /compute/v2.1/servers/e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7 => generated 1280 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:32:36.346347 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-4dea4b0b-37ee-4f58-8a86-ff260a61383d tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Action: 'create', calling method: .version_select at 0x7fe36824ba60>, body: {"keypair": {"name": "tempest-keypair-1321638104", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGf+rX7L+nAha4d8qFDef/p/NHGczXeGzaHEzHsp6HpL//cZDor0AnEL2s0h7jP85qYUIpUC8Z6XQ2td5HJlBtHEJqE0IoMCs/cxG2N/4BfRzjeGf5AJd+wSO6wo5wwJGg=="}} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:32:36.381714 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.quota [None req-4dea4b0b-37ee-4f58-8a86-ff260a61383d tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Getting quotas for project 4f5916770e9b443489fe7aa76d663fe1. Resources: {'key_pairs'} {{(pid=124349) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 21:32:36.392241 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.quota [None req-4dea4b0b-37ee-4f58-8a86-ff260a61383d tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Getting quotas for user 6d16feb169ac46f7983a6b8045de77c9 and project 4f5916770e9b443489fe7aa76d663fe1. Resources: {'key_pairs'} {{(pid=124349) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 21:32:36.449933 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-4dea4b0b-37ee-4f58-8a86-ff260a61383d tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.868725 May 19 21:32:36.451654 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 19/39] 10.222.0.65 () {60 vars in 1158 bytes} [Thu May 19 21:32:35 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 21:32:36.458304 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-a41029a2-3aad-4bb8-84fa-94e5a212e80a tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:32:36.459299 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-a41029a2-3aad-4bb8-84fa-94e5a212e80a tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] [instance: c31d034b-2cf3-4518-8e50-8beda1897c20] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:32:36.472968 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a41029a2-3aad-4bb8-84fa-94e5a212e80a tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:32:36.474020 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a41029a2-3aad-4bb8-84fa-94e5a212e80a tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:32:36.480231 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a41029a2-3aad-4bb8-84fa-94e5a212e80a tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:32:36.480983 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a41029a2-3aad-4bb8-84fa-94e5a212e80a tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:32:36.553559 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [req-5b64746c-2d24-4f0f-88b6-d2de5288578e req-7464ac64-d877-4039-b8cb-55cd1e2fbbaa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c31d034b-2cf3-4518-8e50-8beda1897c20", "tag": "4027ae3d-2633-4456-b298-d5add36a2a85"}]} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:32:36.580181 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-5b64746c-2d24-4f0f-88b6-d2de5288578e req-7464ac64-d877-4039-b8cb-55cd1e2fbbaa service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:32:36.590905 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-5b64746c-2d24-4f0f-88b6-d2de5288578e req-7464ac64-d877-4039-b8cb-55cd1e2fbbaa service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:32:36.666392 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.compute.server_external_events [req-5b64746c-2d24-4f0f-88b6-d2de5288578e req-7464ac64-d877-4039-b8cb-55cd1e2fbbaa service nova] Creating event network-changed:4027ae3d-2633-4456-b298-d5add36a2a85 for instance c31d034b-2cf3-4518-8e50-8beda1897c20 on hv-cinder-83563 May 19 21:32:36.669263 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-5b64746c-2d24-4f0f-88b6-d2de5288578e req-7464ac64-d877-4039-b8cb-55cd1e2fbbaa service nova] Acquired lock "compute-rpcapi-router" {{(pid=124350) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 19 21:32:36.672439 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c34ce129-0aae-4abc-bf5f-54411a5f1846 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:32:36.673195 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c34ce129-0aae-4abc-bf5f-54411a5f1846 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:32:36.678209 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c34ce129-0aae-4abc-bf5f-54411a5f1846 None None] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:32:36.679788 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c34ce129-0aae-4abc-bf5f-54411a5f1846 None None] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:32:36.714112 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.compute.rpcapi [None req-c34ce129-0aae-4abc-bf5f-54411a5f1846 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 19 21:32:36.717791 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c34ce129-0aae-4abc-bf5f-54411a5f1846 None None] Releasing lock "compute-rpcapi-router" {{(pid=124350) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 19 21:32:36.759480 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-c34ce129-0aae-4abc-bf5f-54411a5f1846 None None] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.854412 May 19 21:32:36.760748 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 21/40] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 21:32:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 21:32:36.774336 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-a41029a2-3aad-4bb8-84fa-94e5a212e80a tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc570204a2bb4889889a67850dd1d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6166dc89ce0545c1bbb8adb947034e79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:32:36.775136 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-08ac55ef-58a3-4365-bfc5-bd6ef413e472 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:32:36.776356 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-08ac55ef-58a3-4365-bfc5-bd6ef413e472 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:32:36.788001 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-a41029a2-3aad-4bb8-84fa-94e5a212e80a tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] 10.222.0.65 "GET /compute/v2.1/servers/c31d034b-2cf3-4518-8e50-8beda1897c20" status: 200 len: 1314 microversion: 2.1 time: 0.333387 May 19 21:32:36.802422 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 20/41] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:32:36 2022] GET /compute/v2.1/servers/c31d034b-2cf3-4518-8e50-8beda1897c20 => generated 1314 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:32:36.809103 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-08ac55ef-58a3-4365-bfc5-bd6ef413e472 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:32:36.809749 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-08ac55ef-58a3-4365-bfc5-bd6ef413e472 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:32:36.810628 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-08ac55ef-58a3-4365-bfc5-bd6ef413e472 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:32:36.814772 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-08ac55ef-58a3-4365-bfc5-bd6ef413e472 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:32:37.559585 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-08ac55ef-58a3-4365-bfc5-bd6ef413e472 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1589968f375946a38e82ec484afc837f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c62c1f3c54f568abdac37360ab457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:32:37.573616 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-08ac55ef-58a3-4365-bfc5-bd6ef413e472 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "GET /compute/v2.1/servers/e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7" status: 200 len: 1280 microversion: 2.1 time: 0.802692 May 19 21:32:37.574279 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 22/42] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:32:36 2022] GET /compute/v2.1/servers/e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7 => generated 1280 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:32:37.826026 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-a3a2d16e-790a-4cc9-a568-fed26f4160d6 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:32:37.826656 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-a3a2d16e-790a-4cc9-a568-fed26f4160d6 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] [instance: c31d034b-2cf3-4518-8e50-8beda1897c20] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:32:37.834419 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a3a2d16e-790a-4cc9-a568-fed26f4160d6 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:32:37.834860 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a3a2d16e-790a-4cc9-a568-fed26f4160d6 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:32:37.835810 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a3a2d16e-790a-4cc9-a568-fed26f4160d6 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:32:37.837232 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a3a2d16e-790a-4cc9-a568-fed26f4160d6 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:32:38.591541 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-06c5b6b7-3140-402c-8d68-66e5b4c3cb1a tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:32:38.592954 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-06c5b6b7-3140-402c-8d68-66e5b4c3cb1a tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:32:38.597562 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=6 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:32:38.618577 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-06c5b6b7-3140-402c-8d68-66e5b4c3cb1a tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:32:38.620470 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-06c5b6b7-3140-402c-8d68-66e5b4c3cb1a tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:32:38.623561 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-06c5b6b7-3140-402c-8d68-66e5b4c3cb1a tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:32:38.624348 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-06c5b6b7-3140-402c-8d68-66e5b4c3cb1a tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:32:38.643524 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell1:SELECT=57 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:32:38.897221 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-06c5b6b7-3140-402c-8d68-66e5b4c3cb1a tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1589968f375946a38e82ec484afc837f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c62c1f3c54f568abdac37360ab457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:32:38.899260 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-06c5b6b7-3140-402c-8d68-66e5b4c3cb1a tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "GET /compute/v2.1/servers/e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7" status: 200 len: 1280 microversion: 2.1 time: 0.311438 May 19 21:32:38.901537 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 23/43] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:32:38 2022] GET /compute/v2.1/servers/e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7 => generated 1280 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:32:39.202586 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [req-a2c00d88-f819-4d1d-9a30-588305bdba86 req-7e221f84-44da-4b94-b592-917cc36bf5f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a18b9269-6ed1-4af1-a0da-8260f38fbf39", "tag": "7e0ac86c-4227-4467-92ca-7b8942e9f54c"}]} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:32:39.222823 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-a2c00d88-f819-4d1d-9a30-588305bdba86 req-7e221f84-44da-4b94-b592-917cc36bf5f7 service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:32:39.223373 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-a2c00d88-f819-4d1d-9a30-588305bdba86 req-7e221f84-44da-4b94-b592-917cc36bf5f7 service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:32:39.235941 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.compute.server_external_events [req-a2c00d88-f819-4d1d-9a30-588305bdba86 req-7e221f84-44da-4b94-b592-917cc36bf5f7 service nova] Creating event network-changed:7e0ac86c-4227-4467-92ca-7b8942e9f54c for instance a18b9269-6ed1-4af1-a0da-8260f38fbf39 on hv-cinder-83563 May 19 21:32:39.245424 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [req-a2c00d88-f819-4d1d-9a30-588305bdba86 req-7e221f84-44da-4b94-b592-917cc36bf5f7 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.342381 May 19 21:32:39.246058 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 24/44] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 21:32:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 21:32:39.419467 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-6ca2dcbf-4ea2-4992-98f9-b2a123e0e925 tempest-VolumesGetTestJSON-1087509433 tempest-VolumesGetTestJSON-1087509433-project] Action: 'create', calling method: .version_select at 0x7fe3683288b0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1160995501", "metadata": {"Type": "work"}}} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:32:39.509245 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-a3a2d16e-790a-4cc9-a568-fed26f4160d6 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc570204a2bb4889889a67850dd1d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6166dc89ce0545c1bbb8adb947034e79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:32:39.518248 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-a3a2d16e-790a-4cc9-a568-fed26f4160d6 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] 10.222.0.65 "GET /compute/v2.1/servers/c31d034b-2cf3-4518-8e50-8beda1897c20" status: 200 len: 1314 microversion: 2.1 time: 1.712546 May 19 21:32:39.518926 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 21/45] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:32:37 2022] GET /compute/v2.1/servers/c31d034b-2cf3-4518-8e50-8beda1897c20 => generated 1314 bytes in 1714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:32:39.918769 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-63715102-12fd-4cf5-9c27-bf66fd9b3c54 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:32:39.919377 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-63715102-12fd-4cf5-9c27-bf66fd9b3c54 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:32:39.930726 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-63715102-12fd-4cf5-9c27-bf66fd9b3c54 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:32:39.931254 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-63715102-12fd-4cf5-9c27-bf66fd9b3c54 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:32:39.931969 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-63715102-12fd-4cf5-9c27-bf66fd9b3c54 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:32:39.932398 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-63715102-12fd-4cf5-9c27-bf66fd9b3c54 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:32:40.150119 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-6ca2dcbf-4ea2-4992-98f9-b2a123e0e925 tempest-VolumesGetTestJSON-1087509433 tempest-VolumesGetTestJSON-1087509433-project] 10.222.0.65 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.902253 May 19 21:32:40.151815 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 25/46] 10.222.0.65 () {60 vars in 1155 bytes} [Thu May 19 21:32:39 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 905 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 19 21:32:40.162856 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-46ada342-f470-421e-8980-ec2bcf7d08f9 tempest-VolumesGetTestJSON-1087509433 tempest-VolumesGetTestJSON-1087509433-project] Calling method '.version_select at 0x7fe36832e4c0>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:32:40.235050 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-46ada342-f470-421e-8980-ec2bcf7d08f9 tempest-VolumesGetTestJSON-1087509433 tempest-VolumesGetTestJSON-1087509433-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/30a920a7-b8ce-480e-8e61-655e652973f9" status: 200 len: 353 microversion: 2.1 time: 0.075811 May 19 21:32:40.235747 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 26/47] 10.222.0.65 () {58 vars in 1244 bytes} [Thu May 19 21:32:40 2022] GET /compute/v2.1/os-volumes/30a920a7-b8ce-480e-8e61-655e652973f9 => generated 353 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 21:32:40.390000 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-63715102-12fd-4cf5-9c27-bf66fd9b3c54 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1589968f375946a38e82ec484afc837f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c62c1f3c54f568abdac37360ab457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:32:40.402984 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-63715102-12fd-4cf5-9c27-bf66fd9b3c54 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "GET /compute/v2.1/servers/e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7" status: 200 len: 1280 microversion: 2.1 time: 0.487999 May 19 21:32:40.409984 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 22/48] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:32:39 2022] GET /compute/v2.1/servers/e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7 => generated 1280 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 21:32:40.540704 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-5bf0ba5c-3a6c-4cdd-a413-f4b1e4bbce59 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:32:40.543849 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-5bf0ba5c-3a6c-4cdd-a413-f4b1e4bbce59 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] [instance: c31d034b-2cf3-4518-8e50-8beda1897c20] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:32:40.568559 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5bf0ba5c-3a6c-4cdd-a413-f4b1e4bbce59 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:32:40.572959 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5bf0ba5c-3a6c-4cdd-a413-f4b1e4bbce59 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:32:40.576736 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5bf0ba5c-3a6c-4cdd-a413-f4b1e4bbce59 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:32:40.586184 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5bf0ba5c-3a6c-4cdd-a413-f4b1e4bbce59 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:32:40.785718 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-bd0da118-5189-4c03-a744-b4d30659344a tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-675068845", "imageRef": "a874457a-f8a8-46f6-bdcc-1fa632a0d3c0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "38652c76-1cd3-45cc-ad2f-1c69d9cadfb3"}], "security_groups": [{"name": "tempest-securitygroup--935756938"}], "key_name": "tempest-keypair-1164290557", "user_data": "}} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:32:41.169206 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-5bf0ba5c-3a6c-4cdd-a413-f4b1e4bbce59 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc570204a2bb4889889a67850dd1d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6166dc89ce0545c1bbb8adb947034e79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:32:41.182696 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-5bf0ba5c-3a6c-4cdd-a413-f4b1e4bbce59 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] 10.222.0.65 "GET /compute/v2.1/servers/c31d034b-2cf3-4518-8e50-8beda1897c20" status: 200 len: 1314 microversion: 2.1 time: 0.648396 May 19 21:32:41.183338 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 27/49] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:32:40 2022] GET /compute/v2.1/servers/c31d034b-2cf3-4518-8e50-8beda1897c20 => generated 1314 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:32:41.248477 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-406738fb-ad05-494c-800e-70e156abf98f tempest-VolumesGetTestJSON-1087509433 tempest-VolumesGetTestJSON-1087509433-project] Calling method '.version_select at 0x7fe36829a8b0>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:32:41.291375 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.network.neutron [None req-bd0da118-5189-4c03-a744-b4d30659344a tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] validate_networks() for [('38652c76-1cd3-45cc-ad2f-1c69d9cadfb3', None, None, None, None, None)] {{(pid=124349) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 19 21:32:41.330491 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-406738fb-ad05-494c-800e-70e156abf98f tempest-VolumesGetTestJSON-1087509433 tempest-VolumesGetTestJSON-1087509433-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/30a920a7-b8ce-480e-8e61-655e652973f9" status: 200 len: 354 microversion: 2.1 time: 0.085890 May 19 21:32:41.331068 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 28/50] 10.222.0.65 () {58 vars in 1244 bytes} [Thu May 19 21:32:41 2022] GET /compute/v2.1/os-volumes/30a920a7-b8ce-480e-8e61-655e652973f9 => generated 354 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 21:32:41.343228 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-4f3ed62e-94a6-4308-99f0-d96f762ef0f2 tempest-VolumesGetTestJSON-1087509433 tempest-VolumesGetTestJSON-1087509433-project] Calling method '.version_select at 0x7fe368328940>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:32:41.419975 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-4f3ed62e-94a6-4308-99f0-d96f762ef0f2 tempest-VolumesGetTestJSON-1087509433 tempest-VolumesGetTestJSON-1087509433-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/30a920a7-b8ce-480e-8e61-655e652973f9" status: 200 len: 354 microversion: 2.1 time: 0.080640 May 19 21:32:41.421467 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 29/51] 10.222.0.65 () {58 vars in 1244 bytes} [Thu May 19 21:32:41 2022] GET /compute/v2.1/os-volumes/30a920a7-b8ce-480e-8e61-655e652973f9 => generated 354 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 21:32:41.435815 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-b41ab053-21b1-4d06-89e1-69c422366a68 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:32:41.436582 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-b41ab053-21b1-4d06-89e1-69c422366a68 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:32:41.451344 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b41ab053-21b1-4d06-89e1-69c422366a68 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:32:41.451784 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b41ab053-21b1-4d06-89e1-69c422366a68 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:32:41.453177 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b41ab053-21b1-4d06-89e1-69c422366a68 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:32:41.453660 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b41ab053-21b1-4d06-89e1-69c422366a68 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:32:41.744782 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-b41ab053-21b1-4d06-89e1-69c422366a68 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1589968f375946a38e82ec484afc837f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c62c1f3c54f568abdac37360ab457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:32:41.756977 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-b41ab053-21b1-4d06-89e1-69c422366a68 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "GET /compute/v2.1/servers/e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7" status: 200 len: 1322 microversion: 2.1 time: 0.333461 May 19 21:32:41.758190 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 30/52] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:32:41 2022] GET /compute/v2.1/servers/e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7 => generated 1322 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:32:41.763883 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-5cae4cb9-899d-4a77-8228-cab4ff6737e6 tempest-VolumesGetTestJSON-1087509433 tempest-VolumesGetTestJSON-1087509433-project] Calling method '.version_select at 0x7fe36832ef70>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:32:41.896136 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-5cae4cb9-899d-4a77-8228-cab4ff6737e6 tempest-VolumesGetTestJSON-1087509433 tempest-VolumesGetTestJSON-1087509433-project] 10.222.0.65 "DELETE /compute/v2.1/os-volumes/30a920a7-b8ce-480e-8e61-655e652973f9" status: 202 len: 0 microversion: 2.1 time: 0.136211 May 19 21:32:41.896910 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 31/53] 10.222.0.65 () {58 vars in 1247 bytes} [Thu May 19 21:32:41 2022] DELETE /compute/v2.1/os-volumes/30a920a7-b8ce-480e-8e61-655e652973f9 => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 21:32:41.912432 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-e2422899-20ed-4966-966f-74400b2f1f19 tempest-VolumesGetTestJSON-1087509433 tempest-VolumesGetTestJSON-1087509433-project] Calling method '.version_select at 0x7fe368242dc0>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:32:41.986147 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-e2422899-20ed-4966-966f-74400b2f1f19 tempest-VolumesGetTestJSON-1087509433 tempest-VolumesGetTestJSON-1087509433-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/30a920a7-b8ce-480e-8e61-655e652973f9" status: 200 len: 353 microversion: 2.1 time: 0.082119 May 19 21:32:41.986952 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 32/54] 10.222.0.65 () {58 vars in 1244 bytes} [Thu May 19 21:32:41 2022] GET /compute/v2.1/os-volumes/30a920a7-b8ce-480e-8e61-655e652973f9 => generated 353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 21:32:42.200305 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-ef68df76-d306-4361-8738-6c7896b4cbd3 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:32:42.201102 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-ef68df76-d306-4361-8738-6c7896b4cbd3 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] [instance: c31d034b-2cf3-4518-8e50-8beda1897c20] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:32:42.216535 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ef68df76-d306-4361-8738-6c7896b4cbd3 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:32:42.217300 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ef68df76-d306-4361-8738-6c7896b4cbd3 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:32:42.219623 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ef68df76-d306-4361-8738-6c7896b4cbd3 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:32:42.221433 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ef68df76-d306-4361-8738-6c7896b4cbd3 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:32:42.447004 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-ef68df76-d306-4361-8738-6c7896b4cbd3 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc570204a2bb4889889a67850dd1d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6166dc89ce0545c1bbb8adb947034e79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:32:42.458926 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell0:SELECT=8 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:32:42.464220 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-ef68df76-d306-4361-8738-6c7896b4cbd3 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] 10.222.0.65 "GET /compute/v2.1/servers/c31d034b-2cf3-4518-8e50-8beda1897c20" status: 200 len: 1314 microversion: 2.1 time: 0.268253 May 19 21:32:42.466700 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 33/55] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:32:42 2022] GET /compute/v2.1/servers/c31d034b-2cf3-4518-8e50-8beda1897c20 => generated 1314 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:32:42.775500 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-2a2dae62-5044-4977-94b6-fe617b125252 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:32:42.777859 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-2a2dae62-5044-4977-94b6-fe617b125252 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:32:42.798562 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2a2dae62-5044-4977-94b6-fe617b125252 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:32:42.799157 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2a2dae62-5044-4977-94b6-fe617b125252 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:32:42.800320 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2a2dae62-5044-4977-94b6-fe617b125252 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:32:42.800877 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2a2dae62-5044-4977-94b6-fe617b125252 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:32:43.017811 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.virt.hardware [None req-bd0da118-5189-4c03-a744-b4d30659344a tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Flavor limits 0:0:0 {{(pid=124349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 21:32:43.018364 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.virt.hardware [None req-bd0da118-5189-4c03-a744-b4d30659344a tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Image limits 0:0:0 {{(pid=124349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 21:32:43.018986 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.virt.hardware [None req-bd0da118-5189-4c03-a744-b4d30659344a tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Flavor pref 0:0:0 {{(pid=124349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 21:32:43.019500 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.virt.hardware [None req-bd0da118-5189-4c03-a744-b4d30659344a tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Image pref 0:0:0 {{(pid=124349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 21:32:43.020308 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.virt.hardware [None req-bd0da118-5189-4c03-a744-b4d30659344a tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 21:32:43.043636 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-bd0da118-5189-4c03-a744-b4d30659344a tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:32:43.044787 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-bd0da118-5189-4c03-a744-b4d30659344a tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:32:43.047047 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-bd0da118-5189-4c03-a744-b4d30659344a tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:32:43.048579 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-bd0da118-5189-4c03-a744-b4d30659344a tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:32:43.090520 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-2a2dae62-5044-4977-94b6-fe617b125252 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1589968f375946a38e82ec484afc837f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c62c1f3c54f568abdac37360ab457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:32:43.102720 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-2a2dae62-5044-4977-94b6-fe617b125252 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "GET /compute/v2.1/servers/e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7" status: 200 len: 1322 microversion: 2.1 time: 0.331280 May 19 21:32:43.105690 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.quota [None req-bd0da118-5189-4c03-a744-b4d30659344a tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Getting quotas for project 92434c51e27a405aaa89a70a660f6d91. Resources: {'ram', 'cores', 'instances'} {{(pid=124349) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 21:32:43.110824 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.quota [None req-bd0da118-5189-4c03-a744-b4d30659344a tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Getting quotas for user f47e7f746a014cb0a35390e7e0ce435d and project 92434c51e27a405aaa89a70a660f6d91. Resources: {'ram', 'cores', 'instances'} {{(pid=124349) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 21:32:43.113974 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 34/56] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:32:42 2022] GET /compute/v2.1/servers/e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7 => generated 1322 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:32:43.120275 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-6be1ba99-839c-4b00-af85-f1c536719736 tempest-VolumesGetTestJSON-1087509433 tempest-VolumesGetTestJSON-1087509433-project] Calling method '.version_select at 0x7fe3682a14c0>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:32:43.145334 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-bd0da118-5189-4c03-a744-b4d30659344a tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Going to run 1 instances... {{(pid=124349) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 21:32:43.148006 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-bd0da118-5189-4c03-a744-b4d30659344a tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: e0250d7d-3766-4555-a9af-2429afad53bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a874457a-f8a8-46f6-bdcc-1fa632a0d3c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124349) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 21:32:43.177400 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.wsgi [None req-6be1ba99-839c-4b00-af85-f1c536719736 tempest-VolumesGetTestJSON-1087509433 tempest-VolumesGetTestJSON-1087509433-project] HTTP exception thrown: Volume 30a920a7-b8ce-480e-8e61-655e652973f9 could not be found. May 19 21:32:43.180704 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-6be1ba99-839c-4b00-af85-f1c536719736 tempest-VolumesGetTestJSON-1087509433 tempest-VolumesGetTestJSON-1087509433-project] Request method failure captured: May 19 21:32:43.180704 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: request: GET /compute/v2.1/os-volumes/30a920a7-b8ce-480e-8e61-655e652973f9 HTTP/1.1 May 19 21:32:43.180704 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Accept: application/json May 19 21:32:43.180704 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Accept-Encoding: identity May 19 21:32:43.180704 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Connection: close May 19 21:32:43.180704 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Content-Length: 0 May 19 21:32:43.180704 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Content-Type: application/json May 19 21:32:43.180704 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Host: 10.222.0.65 May 19 21:32:43.180704 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Openstack-System-Scope: None May 19 21:32:43.180704 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: User-Agent: python-urllib3/1.26.9 May 19 21:32:43.180704 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Auth-Token: gAAAAABihrd2AolAGqPRdG1q7tOZgOVL3j5oDi0ec4jdmj6agNAG0PegCENe0P69YsQj36cA3xAGYkxRHtzKr4Es_YPF-7NguyoLYXvnHdEkXYAKPn2vrUgRtYGAUxOMTGWPeOnSzswoFnKuX0RMdDaizAJaebMP_Ef4heDVClB2_LDSd_nwoPQ May 19 21:32:43.180704 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Domain-Id: None May 19 21:32:43.180704 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Domain-Name: None May 19 21:32:43.180704 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Identity-Status: Confirmed May 19 21:32:43.180704 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Is-Admin-Project: True May 19 21:32:43.180704 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Project-Domain-Id: default May 19 21:32:43.180704 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Project-Domain-Name: Default May 19 21:32:43.180704 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Project-Id: 799367c091bf4817ae4af6651f3cd47f May 19 21:32:43.180704 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Project-Name: tempest-VolumesGetTestJSON-1087509433 May 19 21:32:43.180704 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Role: reader,member May 19 21:32:43.180704 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Roles: reader,member May 19 21:32:43.181871 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/799367c091bf4817ae4af6651f3cd47f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/799367c091bf4817ae4af6651f3cd47f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_799367c091bf4817ae4af6651f3cd47f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/799367c091bf4817ae4af6651f3cd47f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}] May 19 21:32:43.181871 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Tenant: tempest-VolumesGetTestJSON-1087509433 May 19 21:32:43.181871 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Tenant-Id: 799367c091bf4817ae4af6651f3cd47f May 19 21:32:43.181871 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Tenant-Name: tempest-VolumesGetTestJSON-1087509433 May 19 21:32:43.181871 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-User: tempest-VolumesGetTestJSON-1087509433-project May 19 21:32:43.181871 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-User-Domain-Id: default May 19 21:32:43.181871 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-User-Domain-Name: Default May 19 21:32:43.181871 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-User-Id: d87dc63cdfc44556b92138b85a4dd49f May 19 21:32:43.181871 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-User-Name: tempest-VolumesGetTestJSON-1087509433-project May 19 21:32:43.181871 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: method: May 19 21:32:43.181871 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: exception: Volume 30a920a7-b8ce-480e-8e61-655e652973f9 could not be found. May 19 21:32:43.181871 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: action_args: {'id': '30a920a7-b8ce-480e-8e61-655e652973f9'} May 19 21:32:43.181871 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 21:32:43.182618 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:32:43.182618 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 19 21:32:43.182618 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 19 21:32:43.182618 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 19 21:32:43.182618 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi item = cinderclient( May 19 21:32:43.182618 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 19 21:32:43.182618 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 19 21:32:43.182618 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 19 21:32:43.182618 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 19 21:32:43.182618 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 19 21:32:43.182618 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 19 21:32:43.182618 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 21:32:43.182618 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 21:32:43.182618 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 21:32:43.182618 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 21:32:43.182618 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 30a920a7-b8ce-480e-8e61-655e652973f9 could not be found. (HTTP 404) (Request-ID: req-d69e55a8-30c7-4623-98c5-3c6a6b42d1de) May 19 21:32:43.182618 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi May 19 21:32:43.182618 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 21:32:43.182618 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi May 19 21:32:43.183624 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:32:43.183624 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 19 21:32:43.183624 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 19 21:32:43.183624 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 19 21:32:43.183624 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 19 21:32:43.183624 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 19 21:32:43.183624 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 19 21:32:43.183624 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 19 21:32:43.183624 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 19 21:32:43.183624 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 19 21:32:43.183624 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 19 21:32:43.183624 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 19 21:32:43.183624 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi item = cinderclient( May 19 21:32:43.183624 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 19 21:32:43.183624 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 19 21:32:43.183624 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 19 21:32:43.183624 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 19 21:32:43.183624 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 19 21:32:43.183624 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 19 21:32:43.184805 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 21:32:43.184805 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 21:32:43.184805 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 21:32:43.184805 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 21:32:43.184805 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 30a920a7-b8ce-480e-8e61-655e652973f9 could not be found. May 19 21:32:43.184805 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi May 19 21:32:43.184805 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 21:32:43.184805 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi May 19 21:32:43.184805 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:32:43.184805 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 21:32:43.184805 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 21:32:43.184805 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 21:32:43.184805 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 21:32:43.184805 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 21:32:43.184805 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 21:32:43.184805 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 21:32:43.184805 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 21:32:43.184805 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 19 21:32:43.184805 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 21:32:43.185874 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 30a920a7-b8ce-480e-8e61-655e652973f9 could not be found. May 19 21:32:43.185874 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi May 19 21:32:43.185874 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 21:32:43.185874 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi May 19 21:32:43.185874 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:32:43.185874 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 21:32:43.185874 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 21:32:43.185874 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 21:32:43.185874 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 21:32:43.185874 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 30a920a7-b8ce-480e-8e61-655e652973f9 could not be found. May 19 21:32:43.185874 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi May 19 21:32:43.185874 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-6be1ba99-839c-4b00-af85-f1c536719736 tempest-VolumesGetTestJSON-1087509433 tempest-VolumesGetTestJSON-1087509433-project] Returning 404 to user: Volume 30a920a7-b8ce-480e-8e61-655e652973f9 could not be found. {{(pid=124350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 21:32:43.185874 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-6be1ba99-839c-4b00-af85-f1c536719736 tempest-VolumesGetTestJSON-1087509433 tempest-VolumesGetTestJSON-1087509433-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/30a920a7-b8ce-480e-8e61-655e652973f9" status: 404 len: 109 microversion: 2.1 time: 0.066891 May 19 21:32:43.186888 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 35/57] 10.222.0.65 () {58 vars in 1244 bytes} [Thu May 19 21:32:43 2022] GET /compute/v2.1/os-volumes/30a920a7-b8ce-480e-8e61-655e652973f9 => generated 109 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 21:32:43.242197 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-bd0da118-5189-4c03-a744-b4d30659344a tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.460955 May 19 21:32:43.244464 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 23/58] 10.222.0.65 () {62 vars in 1187 bytes} [Thu May 19 21:32:40 2022] POST /compute/v2.1/servers => generated 401 bytes in 2464 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) May 19 21:32:43.256954 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-12967b34-028d-471d-babb-fbbae90b02d9 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:32:43.257758 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-12967b34-028d-471d-babb-fbbae90b02d9 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: e0250d7d-3766-4555-a9af-2429afad53bf] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:32:43.358620 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-12967b34-028d-471d-babb-fbbae90b02d9 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:32:43.376416 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-12967b34-028d-471d-babb-fbbae90b02d9 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:32:43.378532 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-12967b34-028d-471d-babb-fbbae90b02d9 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:32:43.382155 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-12967b34-028d-471d-babb-fbbae90b02d9 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf" status: 200 len: 1281 microversion: 2.20 time: 0.131228 May 19 21:32:43.383355 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 36/59] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:32:43 2022] GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf => generated 1281 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:32:43.484205 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-c3ecfac3-2e06-471a-a2bc-031aadb89a5b tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:32:43.485062 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-c3ecfac3-2e06-471a-a2bc-031aadb89a5b tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] [instance: c31d034b-2cf3-4518-8e50-8beda1897c20] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:32:43.492888 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c3ecfac3-2e06-471a-a2bc-031aadb89a5b tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:32:43.497228 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c3ecfac3-2e06-471a-a2bc-031aadb89a5b tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:32:43.498455 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c3ecfac3-2e06-471a-a2bc-031aadb89a5b tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:32:43.499076 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c3ecfac3-2e06-471a-a2bc-031aadb89a5b tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:32:43.885955 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [req-ead4ffa0-88ac-4783-ad4e-97aacda2b2db req-88983a03-b907-4273-b4a6-53a241227d2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7", "tag": "7339e736-ece9-44ac-91e7-0467d6624578"}]} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:32:43.899657 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-ead4ffa0-88ac-4783-ad4e-97aacda2b2db req-88983a03-b907-4273-b4a6-53a241227d2b service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:32:43.900089 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-ead4ffa0-88ac-4783-ad4e-97aacda2b2db req-88983a03-b907-4273-b4a6-53a241227d2b service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:32:43.950529 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.compute.server_external_events [req-ead4ffa0-88ac-4783-ad4e-97aacda2b2db req-88983a03-b907-4273-b4a6-53a241227d2b service nova] Creating event network-changed:7339e736-ece9-44ac-91e7-0467d6624578 for instance e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7 on hv-cinder-83563 May 19 21:32:43.979552 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [req-ead4ffa0-88ac-4783-ad4e-97aacda2b2db req-88983a03-b907-4273-b4a6-53a241227d2b service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097944 May 19 21:32:43.982360 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 37/60] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 21:32:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 21:32:44.122421 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-4ea93284-2cc5-4b6c-9408-3ccef2b8d0ec tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:32:44.123274 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-4ea93284-2cc5-4b6c-9408-3ccef2b8d0ec tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:32:44.135897 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4ea93284-2cc5-4b6c-9408-3ccef2b8d0ec tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:32:44.137990 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4ea93284-2cc5-4b6c-9408-3ccef2b8d0ec tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:32:44.140631 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4ea93284-2cc5-4b6c-9408-3ccef2b8d0ec tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:32:44.143012 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4ea93284-2cc5-4b6c-9408-3ccef2b8d0ec tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:32:44.202206 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-c3ecfac3-2e06-471a-a2bc-031aadb89a5b tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc570204a2bb4889889a67850dd1d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6166dc89ce0545c1bbb8adb947034e79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:32:44.217306 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-c3ecfac3-2e06-471a-a2bc-031aadb89a5b tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] 10.222.0.65 "GET /compute/v2.1/servers/c31d034b-2cf3-4518-8e50-8beda1897c20" status: 200 len: 1314 microversion: 2.1 time: 0.737016 May 19 21:32:44.218486 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 24/61] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:32:43 2022] GET /compute/v2.1/servers/c31d034b-2cf3-4518-8e50-8beda1897c20 => generated 1314 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:32:44.404249 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-90eff1c4-53ff-4de8-a6de-48b925a1388f tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:32:44.405171 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-90eff1c4-53ff-4de8-a6de-48b925a1388f tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: e0250d7d-3766-4555-a9af-2429afad53bf] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:32:44.418365 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-90eff1c4-53ff-4de8-a6de-48b925a1388f tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:32:44.418365 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-90eff1c4-53ff-4de8-a6de-48b925a1388f tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:32:44.418365 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-90eff1c4-53ff-4de8-a6de-48b925a1388f tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:32:44.421207 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-90eff1c4-53ff-4de8-a6de-48b925a1388f tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:32:44.421801 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-4ea93284-2cc5-4b6c-9408-3ccef2b8d0ec tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1589968f375946a38e82ec484afc837f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c62c1f3c54f568abdac37360ab457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:32:44.434540 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-4ea93284-2cc5-4b6c-9408-3ccef2b8d0ec tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "GET /compute/v2.1/servers/e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7" status: 200 len: 1322 microversion: 2.1 time: 0.316753 May 19 21:32:44.437851 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 38/62] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:32:44 2022] GET /compute/v2.1/servers/e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7 => generated 1322 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:32:44.491045 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-90eff1c4-53ff-4de8-a6de-48b925a1388f tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:32:44.499428 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-90eff1c4-53ff-4de8-a6de-48b925a1388f tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:32:44.501202 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-90eff1c4-53ff-4de8-a6de-48b925a1388f tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:32:44.502765 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-90eff1c4-53ff-4de8-a6de-48b925a1388f tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf" status: 200 len: 1333 microversion: 2.20 time: 0.104175 May 19 21:32:44.503906 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 25/63] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:32:44 2022] GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf => generated 1333 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 21:32:44.573798 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-d66b069a-fb77-4d50-9398-fb76b913f9a8 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-786447522", "imageRef": "a874457a-f8a8-46f6-bdcc-1fa632a0d3c0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b9d96816-1157-468c-bb81-22f27d368a2b"}], "security_groups": [{"name": "tempest-securitygroup--992771843"}], "key_name": "tempest-keypair-1321638104", "user_data": "}} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:32:44.747584 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.network.neutron [None req-d66b069a-fb77-4d50-9398-fb76b913f9a8 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] validate_networks() for [('b9d96816-1157-468c-bb81-22f27d368a2b', None, None, None, None, None)] {{(pid=124350) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 19 21:32:45.240957 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-2348f717-648f-40c7-87b8-9533b05191a1 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:32:45.241502 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-2348f717-648f-40c7-87b8-9533b05191a1 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] [instance: c31d034b-2cf3-4518-8e50-8beda1897c20] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:32:45.261727 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-2348f717-648f-40c7-87b8-9533b05191a1 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:32:45.266334 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-2348f717-648f-40c7-87b8-9533b05191a1 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:32:45.267420 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-2348f717-648f-40c7-87b8-9533b05191a1 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:32:45.270155 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-2348f717-648f-40c7-87b8-9533b05191a1 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:32:45.364691 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.virt.hardware [None req-d66b069a-fb77-4d50-9398-fb76b913f9a8 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Flavor limits 0:0:0 {{(pid=124350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 21:32:45.365339 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.virt.hardware [None req-d66b069a-fb77-4d50-9398-fb76b913f9a8 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Image limits 0:0:0 {{(pid=124350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 21:32:45.366783 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.virt.hardware [None req-d66b069a-fb77-4d50-9398-fb76b913f9a8 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Flavor pref 0:0:0 {{(pid=124350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 21:32:45.367530 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.virt.hardware [None req-d66b069a-fb77-4d50-9398-fb76b913f9a8 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Image pref 0:0:0 {{(pid=124350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 21:32:45.369396 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.virt.hardware [None req-d66b069a-fb77-4d50-9398-fb76b913f9a8 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 21:32:45.390318 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d66b069a-fb77-4d50-9398-fb76b913f9a8 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:32:45.391785 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d66b069a-fb77-4d50-9398-fb76b913f9a8 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:32:45.392909 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d66b069a-fb77-4d50-9398-fb76b913f9a8 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:32:45.394958 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d66b069a-fb77-4d50-9398-fb76b913f9a8 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:32:45.433228 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.quota [None req-d66b069a-fb77-4d50-9398-fb76b913f9a8 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Getting quotas for project 4f5916770e9b443489fe7aa76d663fe1. Resources: {'ram', 'cores', 'instances'} {{(pid=124350) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 21:32:45.445016 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.quota [None req-d66b069a-fb77-4d50-9398-fb76b913f9a8 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Getting quotas for user 6d16feb169ac46f7983a6b8045de77c9 and project 4f5916770e9b443489fe7aa76d663fe1. Resources: {'ram', 'cores', 'instances'} {{(pid=124350) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 21:32:45.472465 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-d66b069a-fb77-4d50-9398-fb76b913f9a8 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Going to run 1 instances... {{(pid=124350) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 21:32:45.477728 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-d66b069a-fb77-4d50-9398-fb76b913f9a8 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] [instance: a392a14d-152c-467f-8031-a4bb8e36e5bb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a874457a-f8a8-46f6-bdcc-1fa632a0d3c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124350) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 21:32:45.493102 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-2348f717-648f-40c7-87b8-9533b05191a1 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc570204a2bb4889889a67850dd1d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6166dc89ce0545c1bbb8adb947034e79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:32:45.505793 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-2348f717-648f-40c7-87b8-9533b05191a1 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] 10.222.0.65 "GET /compute/v2.1/servers/c31d034b-2cf3-4518-8e50-8beda1897c20" status: 200 len: 1314 microversion: 2.1 time: 0.267447 May 19 21:32:45.505793 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 26/64] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:32:45 2022] GET /compute/v2.1/servers/c31d034b-2cf3-4518-8e50-8beda1897c20 => generated 1314 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:32:45.520402 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-c3ffd619-29e7-4fc6-90e7-bf3c538d8d40 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:32:45.521350 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-c3ffd619-29e7-4fc6-90e7-bf3c538d8d40 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:32:45.529418 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c3ffd619-29e7-4fc6-90e7-bf3c538d8d40 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:32:45.530521 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c3ffd619-29e7-4fc6-90e7-bf3c538d8d40 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:32:45.531580 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c3ffd619-29e7-4fc6-90e7-bf3c538d8d40 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:32:45.532218 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c3ffd619-29e7-4fc6-90e7-bf3c538d8d40 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:32:45.556078 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-d66b069a-fb77-4d50-9398-fb76b913f9a8 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.988836 May 19 21:32:45.562099 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 39/65] 10.222.0.65 () {60 vars in 1146 bytes} [Thu May 19 21:32:44 2022] POST /compute/v2.1/servers => generated 401 bytes in 991 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 19 21:32:45.564568 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-4116e5ef-b4bd-414c-84ec-1f87167fe7f1 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:32:45.566099 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-4116e5ef-b4bd-414c-84ec-1f87167fe7f1 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: e0250d7d-3766-4555-a9af-2429afad53bf] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:32:45.579545 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4116e5ef-b4bd-414c-84ec-1f87167fe7f1 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:32:45.580346 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4116e5ef-b4bd-414c-84ec-1f87167fe7f1 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:32:45.581900 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4116e5ef-b4bd-414c-84ec-1f87167fe7f1 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:32:45.581900 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4116e5ef-b4bd-414c-84ec-1f87167fe7f1 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:32:45.663281 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-4116e5ef-b4bd-414c-84ec-1f87167fe7f1 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:32:45.675807 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-4116e5ef-b4bd-414c-84ec-1f87167fe7f1 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:32:45.678710 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-4116e5ef-b4bd-414c-84ec-1f87167fe7f1 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:32:45.680489 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-4116e5ef-b4bd-414c-84ec-1f87167fe7f1 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf" status: 200 len: 1333 microversion: 2.20 time: 0.120548 May 19 21:32:45.682102 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 40/66] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:32:45 2022] GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf => generated 1333 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:32:45.693068 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-5b3618ae-44f7-44b4-a5ae-cfd286ba457e tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:32:45.693684 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-5b3618ae-44f7-44b4-a5ae-cfd286ba457e tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] [instance: a392a14d-152c-467f-8031-a4bb8e36e5bb] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:32:45.771357 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-c3ffd619-29e7-4fc6-90e7-bf3c538d8d40 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1589968f375946a38e82ec484afc837f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c62c1f3c54f568abdac37360ab457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:32:45.780529 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-c3ffd619-29e7-4fc6-90e7-bf3c538d8d40 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "GET /compute/v2.1/servers/e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7" status: 200 len: 1322 microversion: 2.1 time: 0.276207 May 19 21:32:45.796013 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 27/67] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:32:45 2022] GET /compute/v2.1/servers/e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7 => generated 1322 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:32:45.817229 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-5b3618ae-44f7-44b4-a5ae-cfd286ba457e tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d16feb169ac46f7983a6b8045de77c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f5916770e9b443489fe7aa76d663fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:32:45.826542 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-5b3618ae-44f7-44b4-a5ae-cfd286ba457e tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] 10.222.0.65 "GET /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb" status: 200 len: 1237 microversion: 2.1 time: 0.138946 May 19 21:32:45.831037 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 41/68] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:32:45 2022] GET /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb => generated 1237 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:32:46.524259 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-5be53ecb-2260-456f-b0f1-7914f7ef1ae3 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:32:46.524981 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-5be53ecb-2260-456f-b0f1-7914f7ef1ae3 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] [instance: c31d034b-2cf3-4518-8e50-8beda1897c20] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:32:46.537631 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-5be53ecb-2260-456f-b0f1-7914f7ef1ae3 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:32:46.538690 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-5be53ecb-2260-456f-b0f1-7914f7ef1ae3 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:32:46.540663 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-5be53ecb-2260-456f-b0f1-7914f7ef1ae3 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:32:46.541545 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-5be53ecb-2260-456f-b0f1-7914f7ef1ae3 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:32:46.699934 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-8e81ab73-22f5-4b88-a267-68e512ff3aae tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:32:46.702013 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-8e81ab73-22f5-4b88-a267-68e512ff3aae tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: e0250d7d-3766-4555-a9af-2429afad53bf] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:32:46.713534 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8e81ab73-22f5-4b88-a267-68e512ff3aae tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:32:46.714078 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8e81ab73-22f5-4b88-a267-68e512ff3aae tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:32:46.714974 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8e81ab73-22f5-4b88-a267-68e512ff3aae tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:32:46.715504 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8e81ab73-22f5-4b88-a267-68e512ff3aae tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:32:46.750945 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-5be53ecb-2260-456f-b0f1-7914f7ef1ae3 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc570204a2bb4889889a67850dd1d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6166dc89ce0545c1bbb8adb947034e79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:32:46.760624 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-5be53ecb-2260-456f-b0f1-7914f7ef1ae3 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] 10.222.0.65 "GET /compute/v2.1/servers/c31d034b-2cf3-4518-8e50-8beda1897c20" status: 200 len: 1314 microversion: 2.1 time: 0.242161 May 19 21:32:46.761618 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 28/69] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:32:46 2022] GET /compute/v2.1/servers/c31d034b-2cf3-4518-8e50-8beda1897c20 => generated 1314 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:32:46.803331 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-a436d70e-ba45-445d-bd9d-470cdc8ce543 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:32:46.805030 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-a436d70e-ba45-445d-bd9d-470cdc8ce543 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:32:46.812326 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a436d70e-ba45-445d-bd9d-470cdc8ce543 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:32:46.813376 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a436d70e-ba45-445d-bd9d-470cdc8ce543 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:32:46.815617 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a436d70e-ba45-445d-bd9d-470cdc8ce543 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:32:46.816955 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a436d70e-ba45-445d-bd9d-470cdc8ce543 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:32:46.829477 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-8e81ab73-22f5-4b88-a267-68e512ff3aae tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:32:46.843363 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-8e81ab73-22f5-4b88-a267-68e512ff3aae tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:32:46.861154 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-8e81ab73-22f5-4b88-a267-68e512ff3aae tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:32:46.863709 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-8e81ab73-22f5-4b88-a267-68e512ff3aae tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf" status: 200 len: 1333 microversion: 2.20 time: 0.166294 May 19 21:32:46.880585 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 42/70] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:32:46 2022] GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf => generated 1333 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:32:46.895139 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-a2d2b420-9ade-41c8-b3e1-6b8733b2c2a7 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:32:46.896520 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-a2d2b420-9ade-41c8-b3e1-6b8733b2c2a7 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] [instance: a392a14d-152c-467f-8031-a4bb8e36e5bb] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:32:46.910634 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a2d2b420-9ade-41c8-b3e1-6b8733b2c2a7 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:32:46.917500 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a2d2b420-9ade-41c8-b3e1-6b8733b2c2a7 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:32:46.931418 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a2d2b420-9ade-41c8-b3e1-6b8733b2c2a7 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:32:46.932021 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a2d2b420-9ade-41c8-b3e1-6b8733b2c2a7 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:32:47.180592 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-a2d2b420-9ade-41c8-b3e1-6b8733b2c2a7 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d16feb169ac46f7983a6b8045de77c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f5916770e9b443489fe7aa76d663fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:32:47.192683 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-a2d2b420-9ade-41c8-b3e1-6b8733b2c2a7 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] 10.222.0.65 "GET /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb" status: 200 len: 1233 microversion: 2.1 time: 0.310455 May 19 21:32:47.193970 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 43/71] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:32:46 2022] GET /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb => generated 1233 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:32:47.504214 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-a436d70e-ba45-445d-bd9d-470cdc8ce543 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1589968f375946a38e82ec484afc837f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c62c1f3c54f568abdac37360ab457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:32:47.512985 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-a436d70e-ba45-445d-bd9d-470cdc8ce543 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "GET /compute/v2.1/servers/e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7" status: 200 len: 1322 microversion: 2.1 time: 0.715987 May 19 21:32:47.516688 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 29/72] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:32:46 2022] GET /compute/v2.1/servers/e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7 => generated 1322 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:32:47.820599 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-aa1cf79c-923c-4e6f-8a28-e7d09c15ac47 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:32:47.827419 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-aa1cf79c-923c-4e6f-8a28-e7d09c15ac47 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] [instance: c31d034b-2cf3-4518-8e50-8beda1897c20] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:32:47.865166 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-aa1cf79c-923c-4e6f-8a28-e7d09c15ac47 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:32:47.870006 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-aa1cf79c-923c-4e6f-8a28-e7d09c15ac47 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:32:47.874343 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-aa1cf79c-923c-4e6f-8a28-e7d09c15ac47 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:32:47.878689 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-aa1cf79c-923c-4e6f-8a28-e7d09c15ac47 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:32:47.881905 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-9fc49e0f-ced2-4a38-b397-15d857a6959a tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:32:47.884149 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-9fc49e0f-ced2-4a38-b397-15d857a6959a tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: e0250d7d-3766-4555-a9af-2429afad53bf] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:32:47.894854 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-9fc49e0f-ced2-4a38-b397-15d857a6959a tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:32:47.897822 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-9fc49e0f-ced2-4a38-b397-15d857a6959a tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:32:47.898923 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-9fc49e0f-ced2-4a38-b397-15d857a6959a tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:32:47.901544 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-9fc49e0f-ced2-4a38-b397-15d857a6959a tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:32:48.026632 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-9fc49e0f-ced2-4a38-b397-15d857a6959a tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:32:48.029225 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_cell1:SELECT=81 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:32:48.037603 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-9fc49e0f-ced2-4a38-b397-15d857a6959a tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:32:48.045429 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-9fc49e0f-ced2-4a38-b397-15d857a6959a tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:32:48.047087 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-9fc49e0f-ced2-4a38-b397-15d857a6959a tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf" status: 200 len: 1339 microversion: 2.20 time: 0.169898 May 19 21:32:48.048940 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 30/73] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:32:47 2022] GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf => generated 1339 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 21:32:48.213498 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-eca45d3c-a3bd-4fa5-afda-11cff8021bbc tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:32:48.214987 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-eca45d3c-a3bd-4fa5-afda-11cff8021bbc tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] [instance: a392a14d-152c-467f-8031-a4bb8e36e5bb] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:32:48.221193 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=8 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:32:48.240394 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-eca45d3c-a3bd-4fa5-afda-11cff8021bbc tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:32:48.240844 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-eca45d3c-a3bd-4fa5-afda-11cff8021bbc tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:32:48.241624 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-eca45d3c-a3bd-4fa5-afda-11cff8021bbc tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:32:48.242063 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-eca45d3c-a3bd-4fa5-afda-11cff8021bbc tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:32:48.327607 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-aa1cf79c-923c-4e6f-8a28-e7d09c15ac47 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc570204a2bb4889889a67850dd1d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6166dc89ce0545c1bbb8adb947034e79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:32:48.339713 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-aa1cf79c-923c-4e6f-8a28-e7d09c15ac47 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] 10.222.0.65 "GET /compute/v2.1/servers/c31d034b-2cf3-4518-8e50-8beda1897c20" status: 200 len: 1314 microversion: 2.1 time: 0.563215 May 19 21:32:48.349804 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 44/74] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:32:47 2022] GET /compute/v2.1/servers/c31d034b-2cf3-4518-8e50-8beda1897c20 => generated 1314 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:32:48.382740 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-eca45d3c-a3bd-4fa5-afda-11cff8021bbc tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d16feb169ac46f7983a6b8045de77c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f5916770e9b443489fe7aa76d663fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:32:48.393514 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-eca45d3c-a3bd-4fa5-afda-11cff8021bbc tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] 10.222.0.65 "GET /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb" status: 200 len: 1295 microversion: 2.1 time: 0.184800 May 19 21:32:48.398876 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 31/75] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:32:48 2022] GET /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb => generated 1295 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:32:48.533038 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-f4af6ac0-91c3-4f77-879b-ada5acef347c tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:32:48.533942 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-f4af6ac0-91c3-4f77-879b-ada5acef347c tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:32:48.549254 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f4af6ac0-91c3-4f77-879b-ada5acef347c tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:32:48.552136 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f4af6ac0-91c3-4f77-879b-ada5acef347c tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:32:48.554310 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f4af6ac0-91c3-4f77-879b-ada5acef347c tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:32:48.555096 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f4af6ac0-91c3-4f77-879b-ada5acef347c tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:32:48.778652 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [req-caf78996-f272-47c6-a49c-94d0abb53389 req-4e1133d0-c0cc-4f08-b89e-934570dd2754 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c31d034b-2cf3-4518-8e50-8beda1897c20", "name": "network-vif-plugged", "status": "completed", "tag": "4027ae3d-2633-4456-b298-d5add36a2a85"}]} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:32:48.806913 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-caf78996-f272-47c6-a49c-94d0abb53389 req-4e1133d0-c0cc-4f08-b89e-934570dd2754 service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:32:48.807591 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-caf78996-f272-47c6-a49c-94d0abb53389 req-4e1133d0-c0cc-4f08-b89e-934570dd2754 service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:32:48.881445 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.compute.server_external_events [req-caf78996-f272-47c6-a49c-94d0abb53389 req-4e1133d0-c0cc-4f08-b89e-934570dd2754 service nova] Creating event network-vif-plugged:4027ae3d-2633-4456-b298-d5add36a2a85 for instance c31d034b-2cf3-4518-8e50-8beda1897c20 on hv-cinder-83563 May 19 21:32:48.881984 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-caf78996-f272-47c6-a49c-94d0abb53389 req-4e1133d0-c0cc-4f08-b89e-934570dd2754 service nova] Acquired lock "compute-rpcapi-router" {{(pid=124349) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 19 21:32:48.883171 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-d8a29433-3c24-4421-adb5-fb1a35422a62 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:32:48.883605 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-d8a29433-3c24-4421-adb5-fb1a35422a62 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:32:48.884378 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-d8a29433-3c24-4421-adb5-fb1a35422a62 None None] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:32:48.884814 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-d8a29433-3c24-4421-adb5-fb1a35422a62 None None] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:32:48.894449 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-f4af6ac0-91c3-4f77-879b-ada5acef347c tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1589968f375946a38e82ec484afc837f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c62c1f3c54f568abdac37360ab457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:32:48.914792 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.compute.rpcapi [None req-d8a29433-3c24-4421-adb5-fb1a35422a62 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 19 21:32:48.915749 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-d8a29433-3c24-4421-adb5-fb1a35422a62 None None] Releasing lock "compute-rpcapi-router" {{(pid=124349) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 19 21:32:48.918563 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-f4af6ac0-91c3-4f77-879b-ada5acef347c tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "GET /compute/v2.1/servers/e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7" status: 200 len: 1322 microversion: 2.1 time: 0.390216 May 19 21:32:48.928951 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 45/76] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:32:48 2022] GET /compute/v2.1/servers/e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7 => generated 1322 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:32:48.960391 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-d8a29433-3c24-4421-adb5-fb1a35422a62 None None] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.285346 May 19 21:32:48.960999 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 32/77] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 21:32:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 21:32:49.065754 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-d65a6255-488c-4a74-bcea-c15451a00d99 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:32:49.066964 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-d65a6255-488c-4a74-bcea-c15451a00d99 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: e0250d7d-3766-4555-a9af-2429afad53bf] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:32:49.080060 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d65a6255-488c-4a74-bcea-c15451a00d99 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:32:49.081035 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d65a6255-488c-4a74-bcea-c15451a00d99 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:32:49.086718 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d65a6255-488c-4a74-bcea-c15451a00d99 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:32:49.087747 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d65a6255-488c-4a74-bcea-c15451a00d99 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:32:49.358753 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-3161d539-6a63-4664-893a-69623cfe8a93 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:32:49.360622 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-3161d539-6a63-4664-893a-69623cfe8a93 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] [instance: c31d034b-2cf3-4518-8e50-8beda1897c20] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:32:49.376939 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-3161d539-6a63-4664-893a-69623cfe8a93 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:32:49.377646 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-3161d539-6a63-4664-893a-69623cfe8a93 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:32:49.378868 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-3161d539-6a63-4664-893a-69623cfe8a93 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:32:49.379402 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-3161d539-6a63-4664-893a-69623cfe8a93 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:32:49.385833 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-d65a6255-488c-4a74-bcea-c15451a00d99 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:32:49.395427 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-d65a6255-488c-4a74-bcea-c15451a00d99 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:32:49.396944 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-d65a6255-488c-4a74-bcea-c15451a00d99 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:32:49.398091 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-d65a6255-488c-4a74-bcea-c15451a00d99 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf" status: 200 len: 1406 microversion: 2.20 time: 0.337071 May 19 21:32:49.414535 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 46/78] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:32:49 2022] GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf => generated 1406 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:32:49.423794 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-2f9381a0-0da4-485b-a562-b0ab18a0c706 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:32:49.427798 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-2f9381a0-0da4-485b-a562-b0ab18a0c706 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] [instance: a392a14d-152c-467f-8031-a4bb8e36e5bb] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:32:49.446276 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2f9381a0-0da4-485b-a562-b0ab18a0c706 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:32:49.449284 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2f9381a0-0da4-485b-a562-b0ab18a0c706 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:32:49.450106 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2f9381a0-0da4-485b-a562-b0ab18a0c706 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:32:49.450567 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2f9381a0-0da4-485b-a562-b0ab18a0c706 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:32:49.613794 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-2f9381a0-0da4-485b-a562-b0ab18a0c706 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d16feb169ac46f7983a6b8045de77c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f5916770e9b443489fe7aa76d663fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:32:49.616996 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-3161d539-6a63-4664-893a-69623cfe8a93 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc570204a2bb4889889a67850dd1d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6166dc89ce0545c1bbb8adb947034e79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:32:49.625187 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-2f9381a0-0da4-485b-a562-b0ab18a0c706 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] 10.222.0.65 "GET /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb" status: 200 len: 1295 microversion: 2.1 time: 0.208245 May 19 21:32:49.627044 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-3161d539-6a63-4664-893a-69623cfe8a93 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] 10.222.0.65 "GET /compute/v2.1/servers/c31d034b-2cf3-4518-8e50-8beda1897c20" status: 200 len: 1314 microversion: 2.1 time: 0.273160 May 19 21:32:49.628446 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 33/79] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:32:49 2022] GET /compute/v2.1/servers/c31d034b-2cf3-4518-8e50-8beda1897c20 => generated 1314 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 21:32:49.638759 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 47/80] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:32:49 2022] GET /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb => generated 1295 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:32:49.948832 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-dc7266c3-8c85-4584-8d8f-1083d806c897 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:32:49.949684 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-dc7266c3-8c85-4584-8d8f-1083d806c897 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:32:49.957713 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-dc7266c3-8c85-4584-8d8f-1083d806c897 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:32:49.958161 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-dc7266c3-8c85-4584-8d8f-1083d806c897 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:32:49.958961 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-dc7266c3-8c85-4584-8d8f-1083d806c897 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:32:49.959390 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-dc7266c3-8c85-4584-8d8f-1083d806c897 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:32:50.121865 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-dc7266c3-8c85-4584-8d8f-1083d806c897 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1589968f375946a38e82ec484afc837f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c62c1f3c54f568abdac37360ab457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:32:50.132633 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-dc7266c3-8c85-4584-8d8f-1083d806c897 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "GET /compute/v2.1/servers/e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7" status: 200 len: 1322 microversion: 2.1 time: 0.189835 May 19 21:32:50.143705 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 34/81] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:32:49 2022] GET /compute/v2.1/servers/e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7 => generated 1322 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:32:50.432543 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-4820fa11-6cd8-4fb7-b6c0-0e69e0318fef tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:32:50.433192 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-4820fa11-6cd8-4fb7-b6c0-0e69e0318fef tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: e0250d7d-3766-4555-a9af-2429afad53bf] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:32:50.441211 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4820fa11-6cd8-4fb7-b6c0-0e69e0318fef tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:32:50.441836 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4820fa11-6cd8-4fb7-b6c0-0e69e0318fef tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:32:50.442836 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4820fa11-6cd8-4fb7-b6c0-0e69e0318fef tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:32:50.443475 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4820fa11-6cd8-4fb7-b6c0-0e69e0318fef tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:32:50.649915 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-1be28ee6-4ee1-420e-8c87-0ee550f9f371 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:32:50.651863 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-1be28ee6-4ee1-420e-8c87-0ee550f9f371 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] [instance: a392a14d-152c-467f-8031-a4bb8e36e5bb] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:32:50.662456 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-4820fa11-6cd8-4fb7-b6c0-0e69e0318fef tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:32:50.687828 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-4820fa11-6cd8-4fb7-b6c0-0e69e0318fef tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:32:50.689490 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-4820fa11-6cd8-4fb7-b6c0-0e69e0318fef tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:32:50.690734 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-4820fa11-6cd8-4fb7-b6c0-0e69e0318fef tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf" status: 200 len: 1406 microversion: 2.20 time: 0.262536 May 19 21:32:50.702859 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1be28ee6-4ee1-420e-8c87-0ee550f9f371 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:32:50.704665 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1be28ee6-4ee1-420e-8c87-0ee550f9f371 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:32:50.706755 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1be28ee6-4ee1-420e-8c87-0ee550f9f371 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:32:50.710577 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 48/82] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:32:50 2022] GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf => generated 1406 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:32:50.710749 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1be28ee6-4ee1-420e-8c87-0ee550f9f371 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:32:50.721150 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-4ea4503c-b717-45fa-85f9-f542508ec519 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:32:50.721761 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-4ea4503c-b717-45fa-85f9-f542508ec519 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] [instance: c31d034b-2cf3-4518-8e50-8beda1897c20] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:32:50.754865 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4ea4503c-b717-45fa-85f9-f542508ec519 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:32:50.755484 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4ea4503c-b717-45fa-85f9-f542508ec519 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:32:50.756419 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4ea4503c-b717-45fa-85f9-f542508ec519 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:32:50.757010 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4ea4503c-b717-45fa-85f9-f542508ec519 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:32:51.239570 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-4ea4503c-b717-45fa-85f9-f542508ec519 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc570204a2bb4889889a67850dd1d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6166dc89ce0545c1bbb8adb947034e79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:32:51.245558 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-1be28ee6-4ee1-420e-8c87-0ee550f9f371 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d16feb169ac46f7983a6b8045de77c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f5916770e9b443489fe7aa76d663fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:32:51.254933 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-1be28ee6-4ee1-420e-8c87-0ee550f9f371 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] 10.222.0.65 "GET /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb" status: 200 len: 1295 microversion: 2.1 time: 0.614025 May 19 21:32:51.261294 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-4ea4503c-b717-45fa-85f9-f542508ec519 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] 10.222.0.65 "GET /compute/v2.1/servers/c31d034b-2cf3-4518-8e50-8beda1897c20" status: 200 len: 1314 microversion: 2.1 time: 0.549495 May 19 21:32:51.274774 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 49/83] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:32:50 2022] GET /compute/v2.1/servers/c31d034b-2cf3-4518-8e50-8beda1897c20 => generated 1314 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:32:51.275619 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 35/84] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:32:50 2022] GET /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb => generated 1295 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:32:51.294307 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-19b6b217-5c4f-4b86-a95a-becf0c830bd7 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:32:51.295432 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-19b6b217-5c4f-4b86-a95a-becf0c830bd7 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:32:51.320872 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-19b6b217-5c4f-4b86-a95a-becf0c830bd7 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:32:51.321362 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-19b6b217-5c4f-4b86-a95a-becf0c830bd7 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:32:51.322220 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-19b6b217-5c4f-4b86-a95a-becf0c830bd7 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:32:51.322893 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-19b6b217-5c4f-4b86-a95a-becf0c830bd7 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:32:51.656914 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [req-769d3e06-c473-4d76-9a18-caa71a026b0c req-8a5cee32-14f7-4810-85f5-03dc8f5d6a1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a18b9269-6ed1-4af1-a0da-8260f38fbf39", "name": "network-vif-plugged", "status": "completed", "tag": "7e0ac86c-4227-4467-92ca-7b8942e9f54c"}]} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:32:51.674982 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-769d3e06-c473-4d76-9a18-caa71a026b0c req-8a5cee32-14f7-4810-85f5-03dc8f5d6a1b service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:32:51.675939 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-769d3e06-c473-4d76-9a18-caa71a026b0c req-8a5cee32-14f7-4810-85f5-03dc8f5d6a1b service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:32:51.705409 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.compute.server_external_events [req-769d3e06-c473-4d76-9a18-caa71a026b0c req-8a5cee32-14f7-4810-85f5-03dc8f5d6a1b service nova] Creating event network-vif-plugged:7e0ac86c-4227-4467-92ca-7b8942e9f54c for instance a18b9269-6ed1-4af1-a0da-8260f38fbf39 on hv-cinder-83563 May 19 21:32:51.719878 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [req-769d3e06-c473-4d76-9a18-caa71a026b0c req-8a5cee32-14f7-4810-85f5-03dc8f5d6a1b service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073860 May 19 21:32:51.721738 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 36/85] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 21:32:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 21:32:51.736154 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-c4e61626-9d33-4eed-b5e7-a965518adac9 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:32:51.736867 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-c4e61626-9d33-4eed-b5e7-a965518adac9 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: e0250d7d-3766-4555-a9af-2429afad53bf] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:32:51.752697 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c4e61626-9d33-4eed-b5e7-a965518adac9 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:32:51.753173 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c4e61626-9d33-4eed-b5e7-a965518adac9 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:32:51.758190 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c4e61626-9d33-4eed-b5e7-a965518adac9 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:32:51.758737 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c4e61626-9d33-4eed-b5e7-a965518adac9 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:32:52.023251 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-19b6b217-5c4f-4b86-a95a-becf0c830bd7 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1589968f375946a38e82ec484afc837f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c62c1f3c54f568abdac37360ab457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:32:52.025762 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell1:SELECT=100 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:32:52.033221 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-19b6b217-5c4f-4b86-a95a-becf0c830bd7 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "GET /compute/v2.1/servers/e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7" status: 200 len: 1322 microversion: 2.1 time: 0.752193 May 19 21:32:52.035310 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 50/86] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:32:51 2022] GET /compute/v2.1/servers/e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7 => generated 1322 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:32:52.134602 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-c4e61626-9d33-4eed-b5e7-a965518adac9 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:32:52.144340 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-c4e61626-9d33-4eed-b5e7-a965518adac9 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:32:52.150138 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-c4e61626-9d33-4eed-b5e7-a965518adac9 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:32:52.153339 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-c4e61626-9d33-4eed-b5e7-a965518adac9 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf" status: 200 len: 1406 microversion: 2.20 time: 0.428753 May 19 21:32:52.155718 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 37/87] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:32:51 2022] GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf => generated 1406 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:32:52.282307 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-abb61467-26d0-4380-9d2b-ae0c3803019a tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:32:52.291174 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-367e709f-c9db-45e6-8818-3272a6f56ecb tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:32:52.292511 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-367e709f-c9db-45e6-8818-3272a6f56ecb tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] [instance: c31d034b-2cf3-4518-8e50-8beda1897c20] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:32:52.292869 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-abb61467-26d0-4380-9d2b-ae0c3803019a tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] [instance: a392a14d-152c-467f-8031-a4bb8e36e5bb] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:32:52.312069 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-abb61467-26d0-4380-9d2b-ae0c3803019a tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:32:52.316511 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-abb61467-26d0-4380-9d2b-ae0c3803019a tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:32:52.318568 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-367e709f-c9db-45e6-8818-3272a6f56ecb tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:32:52.320379 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-abb61467-26d0-4380-9d2b-ae0c3803019a tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:32:52.320631 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-367e709f-c9db-45e6-8818-3272a6f56ecb tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:32:52.321672 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-367e709f-c9db-45e6-8818-3272a6f56ecb tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:32:52.327952 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-abb61467-26d0-4380-9d2b-ae0c3803019a tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:32:52.329946 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-367e709f-c9db-45e6-8818-3272a6f56ecb tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:32:52.570200 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-abb61467-26d0-4380-9d2b-ae0c3803019a tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d16feb169ac46f7983a6b8045de77c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f5916770e9b443489fe7aa76d663fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:32:52.587350 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-abb61467-26d0-4380-9d2b-ae0c3803019a tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] 10.222.0.65 "GET /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb" status: 200 len: 1295 microversion: 2.1 time: 0.308595 May 19 21:32:52.590950 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 51/88] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:32:52 2022] GET /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb => generated 1295 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:32:52.704563 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [req-ffc71b5f-96f4-42d8-9cbf-66741d129149 req-6c4db2b4-3f5f-45ea-9c2e-ee959be43b0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0250d7d-3766-4555-a9af-2429afad53bf", "tag": "7fe0112e-1449-4e73-9fa1-f6d3a33168d8"}]} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:32:52.733493 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-ffc71b5f-96f4-42d8-9cbf-66741d129149 req-6c4db2b4-3f5f-45ea-9c2e-ee959be43b0d service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:32:52.738198 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-ffc71b5f-96f4-42d8-9cbf-66741d129149 req-6c4db2b4-3f5f-45ea-9c2e-ee959be43b0d service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:32:52.781128 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.compute.server_external_events [req-ffc71b5f-96f4-42d8-9cbf-66741d129149 req-6c4db2b4-3f5f-45ea-9c2e-ee959be43b0d service nova] Creating event network-changed:7fe0112e-1449-4e73-9fa1-f6d3a33168d8 for instance e0250d7d-3766-4555-a9af-2429afad53bf on hv-cinder-83563 May 19 21:32:52.811314 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [req-ffc71b5f-96f4-42d8-9cbf-66741d129149 req-6c4db2b4-3f5f-45ea-9c2e-ee959be43b0d service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113007 May 19 21:32:52.815859 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 52/89] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 21:32:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 21:32:53.051836 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-274715ba-acd1-4894-b1db-cbe45370c99f tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:32:53.053843 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-274715ba-acd1-4894-b1db-cbe45370c99f tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:32:53.069435 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-274715ba-acd1-4894-b1db-cbe45370c99f tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:32:53.075602 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-274715ba-acd1-4894-b1db-cbe45370c99f tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:32:53.076787 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-274715ba-acd1-4894-b1db-cbe45370c99f tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:32:53.079305 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-274715ba-acd1-4894-b1db-cbe45370c99f tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:32:53.124775 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_cell0:SELECT=22 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:32:53.227364 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-367e709f-c9db-45e6-8818-3272a6f56ecb tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc570204a2bb4889889a67850dd1d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6166dc89ce0545c1bbb8adb947034e79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:32:53.238908 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-367e709f-c9db-45e6-8818-3272a6f56ecb tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] 10.222.0.65 "GET /compute/v2.1/servers/c31d034b-2cf3-4518-8e50-8beda1897c20" status: 200 len: 1314 microversion: 2.1 time: 0.952324 May 19 21:32:53.241129 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 38/90] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:32:52 2022] GET /compute/v2.1/servers/c31d034b-2cf3-4518-8e50-8beda1897c20 => generated 1314 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 21:32:53.247183 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-06961960-bbb2-4597-8dca-bcfb66d8e439 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:32:53.248189 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-06961960-bbb2-4597-8dca-bcfb66d8e439 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: e0250d7d-3766-4555-a9af-2429afad53bf] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:32:53.264991 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-06961960-bbb2-4597-8dca-bcfb66d8e439 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:32:53.268683 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-06961960-bbb2-4597-8dca-bcfb66d8e439 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:32:53.269738 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-06961960-bbb2-4597-8dca-bcfb66d8e439 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:32:53.273704 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-06961960-bbb2-4597-8dca-bcfb66d8e439 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:32:53.491866 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-274715ba-acd1-4894-b1db-cbe45370c99f tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1589968f375946a38e82ec484afc837f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c62c1f3c54f568abdac37360ab457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:32:53.499178 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-274715ba-acd1-4894-b1db-cbe45370c99f tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "GET /compute/v2.1/servers/e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7" status: 200 len: 1322 microversion: 2.1 time: 0.451751 May 19 21:32:53.509206 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 53/91] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:32:53 2022] GET /compute/v2.1/servers/e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7 => generated 1322 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 21:32:53.544662 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-06961960-bbb2-4597-8dca-bcfb66d8e439 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:32:53.553093 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-06961960-bbb2-4597-8dca-bcfb66d8e439 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:32:53.554950 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-06961960-bbb2-4597-8dca-bcfb66d8e439 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:32:53.556122 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-06961960-bbb2-4597-8dca-bcfb66d8e439 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf" status: 200 len: 1406 microversion: 2.20 time: 0.313318 May 19 21:32:53.557189 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 39/92] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:32:53 2022] GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf => generated 1406 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:32:53.608745 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-74cbc1d1-8a78-4a78-80cb-c5c5ea326008 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:32:53.609725 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-74cbc1d1-8a78-4a78-80cb-c5c5ea326008 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] [instance: a392a14d-152c-467f-8031-a4bb8e36e5bb] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:32:53.619593 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-74cbc1d1-8a78-4a78-80cb-c5c5ea326008 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:32:53.620031 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-74cbc1d1-8a78-4a78-80cb-c5c5ea326008 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:32:53.621057 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-74cbc1d1-8a78-4a78-80cb-c5c5ea326008 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:32:53.621499 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-74cbc1d1-8a78-4a78-80cb-c5c5ea326008 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:32:54.211191 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [req-a9ccc3ef-b032-4bd5-8126-fa7c3c7855c2 req-0895a621-1b20-44a0-a768-727b635b1ca8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7", "name": "network-vif-plugged", "status": "completed", "tag": "7339e736-ece9-44ac-91e7-0467d6624578"}]} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:32:54.228040 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-a9ccc3ef-b032-4bd5-8126-fa7c3c7855c2 req-0895a621-1b20-44a0-a768-727b635b1ca8 service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:32:54.228499 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-a9ccc3ef-b032-4bd5-8126-fa7c3c7855c2 req-0895a621-1b20-44a0-a768-727b635b1ca8 service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:32:54.244989 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.compute.server_external_events [req-a9ccc3ef-b032-4bd5-8126-fa7c3c7855c2 req-0895a621-1b20-44a0-a768-727b635b1ca8 service nova] Creating event network-vif-plugged:7339e736-ece9-44ac-91e7-0467d6624578 for instance e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7 on hv-cinder-83563 May 19 21:32:54.251164 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [req-a9ccc3ef-b032-4bd5-8126-fa7c3c7855c2 req-0895a621-1b20-44a0-a768-727b635b1ca8 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043957 May 19 21:32:54.252729 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 40/93] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 21:32:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 21:32:54.258735 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-02c1a500-661e-4dcd-aa3a-c29d1a0e5678 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:32:54.259852 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-02c1a500-661e-4dcd-aa3a-c29d1a0e5678 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] [instance: c31d034b-2cf3-4518-8e50-8beda1897c20] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:32:54.267740 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-02c1a500-661e-4dcd-aa3a-c29d1a0e5678 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:32:54.268762 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-02c1a500-661e-4dcd-aa3a-c29d1a0e5678 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:32:54.269736 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-02c1a500-661e-4dcd-aa3a-c29d1a0e5678 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:32:54.270349 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-02c1a500-661e-4dcd-aa3a-c29d1a0e5678 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:32:54.442188 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-02c1a500-661e-4dcd-aa3a-c29d1a0e5678 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc570204a2bb4889889a67850dd1d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6166dc89ce0545c1bbb8adb947034e79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:32:54.455443 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-02c1a500-661e-4dcd-aa3a-c29d1a0e5678 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] 10.222.0.65 "GET /compute/v2.1/servers/c31d034b-2cf3-4518-8e50-8beda1897c20" status: 200 len: 1501 microversion: 2.1 time: 0.200809 May 19 21:32:54.456517 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 41/94] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:32:54 2022] GET /compute/v2.1/servers/c31d034b-2cf3-4518-8e50-8beda1897c20 => generated 1501 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:32:54.474310 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-74cbc1d1-8a78-4a78-80cb-c5c5ea326008 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d16feb169ac46f7983a6b8045de77c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f5916770e9b443489fe7aa76d663fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:32:54.488321 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-74cbc1d1-8a78-4a78-80cb-c5c5ea326008 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] 10.222.0.65 "GET /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb" status: 200 len: 1362 microversion: 2.1 time: 0.883857 May 19 21:32:54.488902 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 54/95] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:32:53 2022] GET /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb => generated 1362 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:32:54.517250 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-0560d43f-ec3a-4a88-85b0-70ea033967b5 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:32:54.517923 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-0560d43f-ec3a-4a88-85b0-70ea033967b5 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:32:54.529466 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-0560d43f-ec3a-4a88-85b0-70ea033967b5 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:32:54.531214 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-0560d43f-ec3a-4a88-85b0-70ea033967b5 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:32:54.533151 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-0560d43f-ec3a-4a88-85b0-70ea033967b5 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:32:54.533795 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-0560d43f-ec3a-4a88-85b0-70ea033967b5 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:32:54.575173 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-82fbe659-f3c4-4e04-9bec-af1308cc51aa tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:32:54.576065 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-82fbe659-f3c4-4e04-9bec-af1308cc51aa tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: e0250d7d-3766-4555-a9af-2429afad53bf] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:32:54.583836 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-82fbe659-f3c4-4e04-9bec-af1308cc51aa tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:32:54.588510 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-82fbe659-f3c4-4e04-9bec-af1308cc51aa tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:32:54.590348 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-82fbe659-f3c4-4e04-9bec-af1308cc51aa tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:32:54.590955 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-82fbe659-f3c4-4e04-9bec-af1308cc51aa tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:32:54.904411 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-0560d43f-ec3a-4a88-85b0-70ea033967b5 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1589968f375946a38e82ec484afc837f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c62c1f3c54f568abdac37360ab457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:32:54.918972 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-0560d43f-ec3a-4a88-85b0-70ea033967b5 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "GET /compute/v2.1/servers/e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7" status: 200 len: 1322 microversion: 2.1 time: 0.406015 May 19 21:32:54.920569 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 42/96] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:32:54 2022] GET /compute/v2.1/servers/e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7 => generated 1322 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:32:55.131155 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-82fbe659-f3c4-4e04-9bec-af1308cc51aa tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:32:55.148680 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-82fbe659-f3c4-4e04-9bec-af1308cc51aa tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:32:55.156590 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-82fbe659-f3c4-4e04-9bec-af1308cc51aa tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:32:55.163206 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-82fbe659-f3c4-4e04-9bec-af1308cc51aa tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf" status: 200 len: 1406 microversion: 2.20 time: 0.587564 May 19 21:32:55.164016 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 55/97] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:32:54 2022] GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf => generated 1406 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 21:32:55.506575 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-22dd6d71-5fb6-49a9-9ff6-6d9dc038230e tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:32:55.507185 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-22dd6d71-5fb6-49a9-9ff6-6d9dc038230e tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] [instance: a392a14d-152c-467f-8031-a4bb8e36e5bb] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:32:55.524369 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-22dd6d71-5fb6-49a9-9ff6-6d9dc038230e tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:32:55.525051 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-22dd6d71-5fb6-49a9-9ff6-6d9dc038230e tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:32:55.526046 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-22dd6d71-5fb6-49a9-9ff6-6d9dc038230e tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:32:55.526459 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-22dd6d71-5fb6-49a9-9ff6-6d9dc038230e tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:32:55.836552 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [req-946b2f27-f1a7-42e5-a06c-4519ec627d34 req-33e5a243-31e7-4da8-acba-44551e0c33a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a392a14d-152c-467f-8031-a4bb8e36e5bb", "tag": "273956f8-6ada-4c24-9d33-e37b581a5bb1"}]} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:32:55.841688 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell0:SELECT=6 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:32:55.845630 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell0:SELECT=10 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:32:55.861458 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-946b2f27-f1a7-42e5-a06c-4519ec627d34 req-33e5a243-31e7-4da8-acba-44551e0c33a1 service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:32:55.861821 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-946b2f27-f1a7-42e5-a06c-4519ec627d34 req-33e5a243-31e7-4da8-acba-44551e0c33a1 service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:32:55.898358 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.compute.server_external_events [req-946b2f27-f1a7-42e5-a06c-4519ec627d34 req-33e5a243-31e7-4da8-acba-44551e0c33a1 service nova] Creating event network-changed:273956f8-6ada-4c24-9d33-e37b581a5bb1 for instance a392a14d-152c-467f-8031-a4bb8e36e5bb on hv-cinder-83563 May 19 21:32:55.905005 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [req-946b2f27-f1a7-42e5-a06c-4519ec627d34 req-33e5a243-31e7-4da8-acba-44551e0c33a1 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076238 May 19 21:32:55.907662 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 56/98] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 21:32:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 21:32:55.938306 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-40ce6924-633e-4a4c-9387-b03a518a9b17 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:32:55.938754 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-22dd6d71-5fb6-49a9-9ff6-6d9dc038230e tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d16feb169ac46f7983a6b8045de77c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f5916770e9b443489fe7aa76d663fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:32:55.939276 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-40ce6924-633e-4a4c-9387-b03a518a9b17 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:32:55.952269 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-22dd6d71-5fb6-49a9-9ff6-6d9dc038230e tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] 10.222.0.65 "GET /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb" status: 200 len: 1362 microversion: 2.1 time: 0.448143 May 19 21:32:55.954496 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 43/99] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:32:55 2022] GET /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb => generated 1362 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:32:55.963971 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-40ce6924-633e-4a4c-9387-b03a518a9b17 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:32:55.963971 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-40ce6924-633e-4a4c-9387-b03a518a9b17 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:32:55.963971 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-40ce6924-633e-4a4c-9387-b03a518a9b17 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:32:55.963971 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-40ce6924-633e-4a4c-9387-b03a518a9b17 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:32:56.182903 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-24ef06ab-3f31-4831-a2ac-c2197550034a tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:32:56.183736 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-24ef06ab-3f31-4831-a2ac-c2197550034a tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: e0250d7d-3766-4555-a9af-2429afad53bf] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:32:56.198006 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-24ef06ab-3f31-4831-a2ac-c2197550034a tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:32:56.202281 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-24ef06ab-3f31-4831-a2ac-c2197550034a tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:32:56.204041 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-24ef06ab-3f31-4831-a2ac-c2197550034a tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:32:56.204718 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-24ef06ab-3f31-4831-a2ac-c2197550034a tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:32:56.224711 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-40ce6924-633e-4a4c-9387-b03a518a9b17 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1589968f375946a38e82ec484afc837f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c62c1f3c54f568abdac37360ab457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:32:56.242676 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-40ce6924-633e-4a4c-9387-b03a518a9b17 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "GET /compute/v2.1/servers/e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7" status: 200 len: 1322 microversion: 2.1 time: 0.309160 May 19 21:32:56.243520 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 57/100] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:32:55 2022] GET /compute/v2.1/servers/e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7 => generated 1322 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 21:32:56.258989 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-d1aab906-17ab-410f-9bbe-05f6505b0b94 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "81833768-f69e-4121-adb0-0a4d0cd3633e"}} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:32:56.263530 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-d1aab906-17ab-410f-9bbe-05f6505b0b94 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] [instance: c31d034b-2cf3-4518-8e50-8beda1897c20] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:32:56.276727 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d1aab906-17ab-410f-9bbe-05f6505b0b94 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:32:56.277317 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d1aab906-17ab-410f-9bbe-05f6505b0b94 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:32:56.281882 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d1aab906-17ab-410f-9bbe-05f6505b0b94 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:32:56.282993 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d1aab906-17ab-410f-9bbe-05f6505b0b94 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:32:56.693851 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-24ef06ab-3f31-4831-a2ac-c2197550034a tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:32:56.711521 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-24ef06ab-3f31-4831-a2ac-c2197550034a tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:32:56.714705 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-24ef06ab-3f31-4831-a2ac-c2197550034a tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:32:56.716195 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-24ef06ab-3f31-4831-a2ac-c2197550034a tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf" status: 200 len: 1406 microversion: 2.20 time: 0.538046 May 19 21:32:56.717658 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 44/101] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:32:56 2022] GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf => generated 1406 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 21:32:56.980874 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-3bc85d57-7436-4300-9fc7-ebe9bdbf44f9 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:32:56.982619 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-3bc85d57-7436-4300-9fc7-ebe9bdbf44f9 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] [instance: a392a14d-152c-467f-8031-a4bb8e36e5bb] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:32:56.991101 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-3bc85d57-7436-4300-9fc7-ebe9bdbf44f9 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:32:56.992073 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-3bc85d57-7436-4300-9fc7-ebe9bdbf44f9 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:32:56.993643 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-3bc85d57-7436-4300-9fc7-ebe9bdbf44f9 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:32:56.994417 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-3bc85d57-7436-4300-9fc7-ebe9bdbf44f9 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:32:57.201716 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-3bc85d57-7436-4300-9fc7-ebe9bdbf44f9 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d16feb169ac46f7983a6b8045de77c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f5916770e9b443489fe7aa76d663fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:32:57.227962 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-3bc85d57-7436-4300-9fc7-ebe9bdbf44f9 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] 10.222.0.65 "GET /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb" status: 200 len: 1362 microversion: 2.1 time: 0.260059 May 19 21:32:57.229105 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 45/102] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:32:56 2022] GET /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb => generated 1362 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:32:57.259306 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-e0a685e3-bb3e-449c-8b76-cd4c93ed2b4e tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:32:57.260154 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-e0a685e3-bb3e-449c-8b76-cd4c93ed2b4e tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:32:57.274714 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e0a685e3-bb3e-449c-8b76-cd4c93ed2b4e tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:32:57.276223 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e0a685e3-bb3e-449c-8b76-cd4c93ed2b4e tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:32:57.277326 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e0a685e3-bb3e-449c-8b76-cd4c93ed2b4e tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:32:57.278550 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e0a685e3-bb3e-449c-8b76-cd4c93ed2b4e tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:32:57.464365 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-e0a685e3-bb3e-449c-8b76-cd4c93ed2b4e tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1589968f375946a38e82ec484afc837f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c62c1f3c54f568abdac37360ab457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:32:57.474486 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-e0a685e3-bb3e-449c-8b76-cd4c93ed2b4e tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "GET /compute/v2.1/servers/e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7" status: 200 len: 1322 microversion: 2.1 time: 0.219234 May 19 21:32:57.475594 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 46/103] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:32:57 2022] GET /compute/v2.1/servers/e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7 => generated 1322 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 21:32:57.735387 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-82b72d4e-015e-4ce7-92e3-516229476bd9 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:32:57.736239 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-82b72d4e-015e-4ce7-92e3-516229476bd9 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: e0250d7d-3766-4555-a9af-2429afad53bf] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:32:57.748866 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-82b72d4e-015e-4ce7-92e3-516229476bd9 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:32:57.749313 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-82b72d4e-015e-4ce7-92e3-516229476bd9 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:32:57.750094 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-82b72d4e-015e-4ce7-92e3-516229476bd9 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:32:57.750548 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-82b72d4e-015e-4ce7-92e3-516229476bd9 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:32:57.962195 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-82b72d4e-015e-4ce7-92e3-516229476bd9 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:32:57.973161 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-82b72d4e-015e-4ce7-92e3-516229476bd9 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:32:57.975870 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-82b72d4e-015e-4ce7-92e3-516229476bd9 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:32:57.977332 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-82b72d4e-015e-4ce7-92e3-516229476bd9 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf" status: 200 len: 1406 microversion: 2.20 time: 0.246145 May 19 21:32:57.978126 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 47/104] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:32:57 2022] GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf => generated 1406 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 21:32:58.246612 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-43fb9139-8184-403c-bf21-33b824af6c66 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:32:58.247827 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-43fb9139-8184-403c-bf21-33b824af6c66 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] [instance: a392a14d-152c-467f-8031-a4bb8e36e5bb] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:32:58.258837 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-43fb9139-8184-403c-bf21-33b824af6c66 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:32:58.261379 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-43fb9139-8184-403c-bf21-33b824af6c66 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:32:58.262932 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-43fb9139-8184-403c-bf21-33b824af6c66 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:32:58.265368 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-43fb9139-8184-403c-bf21-33b824af6c66 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:32:58.406512 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-d1aab906-17ab-410f-9bbe-05f6505b0b94 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] 10.222.0.65 "POST /compute/v2.1/servers/c31d034b-2cf3-4518-8e50-8beda1897c20/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.158471 May 19 21:32:58.407864 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 58/105] 10.222.0.65 () {60 vars in 1322 bytes} [Thu May 19 21:32:56 2022] POST /compute/v2.1/servers/c31d034b-2cf3-4518-8e50-8beda1897c20/os-volume_attachments => generated 194 bytes in 2161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 21:32:58.490908 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-43fb9139-8184-403c-bf21-33b824af6c66 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d16feb169ac46f7983a6b8045de77c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f5916770e9b443489fe7aa76d663fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:32:58.502392 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-80bc45c3-1eb4-4306-9a0b-7efc9ea80bec tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:32:58.503678 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-80bc45c3-1eb4-4306-9a0b-7efc9ea80bec tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:32:58.504788 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-43fb9139-8184-403c-bf21-33b824af6c66 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] 10.222.0.65 "GET /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb" status: 200 len: 1362 microversion: 2.1 time: 0.263506 May 19 21:32:58.508390 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 48/106] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:32:58 2022] GET /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb => generated 1362 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 21:32:58.535652 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-80bc45c3-1eb4-4306-9a0b-7efc9ea80bec tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:32:58.536446 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-80bc45c3-1eb4-4306-9a0b-7efc9ea80bec tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:32:58.537720 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-80bc45c3-1eb4-4306-9a0b-7efc9ea80bec tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:32:58.538516 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-80bc45c3-1eb4-4306-9a0b-7efc9ea80bec tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:32:58.998684 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-80bc45c3-1eb4-4306-9a0b-7efc9ea80bec tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1589968f375946a38e82ec484afc837f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c62c1f3c54f568abdac37360ab457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:32:59.006284 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-26def1be-6c65-479a-93d0-03bd0e8b35f0 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:32:59.007334 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-26def1be-6c65-479a-93d0-03bd0e8b35f0 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: e0250d7d-3766-4555-a9af-2429afad53bf] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:32:59.010131 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-80bc45c3-1eb4-4306-9a0b-7efc9ea80bec tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "GET /compute/v2.1/servers/e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7" status: 200 len: 1322 microversion: 2.1 time: 0.521171 May 19 21:32:59.011103 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 59/107] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:32:58 2022] GET /compute/v2.1/servers/e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7 => generated 1322 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 21:32:59.022213 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_cell0:SELECT=4 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:32:59.024608 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-26def1be-6c65-479a-93d0-03bd0e8b35f0 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:32:59.025204 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-26def1be-6c65-479a-93d0-03bd0e8b35f0 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:32:59.026546 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-26def1be-6c65-479a-93d0-03bd0e8b35f0 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:32:59.027074 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-26def1be-6c65-479a-93d0-03bd0e8b35f0 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:32:59.033302 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_cell1:SELECT=100 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:32:59.223606 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-26def1be-6c65-479a-93d0-03bd0e8b35f0 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:32:59.236642 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-26def1be-6c65-479a-93d0-03bd0e8b35f0 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:32:59.238486 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-26def1be-6c65-479a-93d0-03bd0e8b35f0 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:32:59.239670 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-26def1be-6c65-479a-93d0-03bd0e8b35f0 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf" status: 200 len: 1406 microversion: 2.20 time: 0.239779 May 19 21:32:59.240251 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 49/108] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:32:58 2022] GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf => generated 1406 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:32:59.542578 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-5eb5b166-f828-4895-ae44-a02b521f8d60 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:32:59.543266 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-5eb5b166-f828-4895-ae44-a02b521f8d60 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] [instance: a392a14d-152c-467f-8031-a4bb8e36e5bb] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:32:59.563555 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5eb5b166-f828-4895-ae44-a02b521f8d60 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:32:59.566596 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5eb5b166-f828-4895-ae44-a02b521f8d60 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:32:59.567413 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5eb5b166-f828-4895-ae44-a02b521f8d60 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:32:59.569500 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5eb5b166-f828-4895-ae44-a02b521f8d60 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:32:59.962992 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-5eb5b166-f828-4895-ae44-a02b521f8d60 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d16feb169ac46f7983a6b8045de77c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f5916770e9b443489fe7aa76d663fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:32:59.973439 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-5eb5b166-f828-4895-ae44-a02b521f8d60 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] 10.222.0.65 "GET /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb" status: 200 len: 1362 microversion: 2.1 time: 0.448014 May 19 21:32:59.985043 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 60/109] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:32:59 2022] GET /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb => generated 1362 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:33:00.027787 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-7eb53ee1-25bb-469d-91f3-4b8c8abc140b tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:33:00.028397 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-7eb53ee1-25bb-469d-91f3-4b8c8abc140b tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:33:00.035509 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-7eb53ee1-25bb-469d-91f3-4b8c8abc140b tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:00.035955 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-7eb53ee1-25bb-469d-91f3-4b8c8abc140b tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:00.036725 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-7eb53ee1-25bb-469d-91f3-4b8c8abc140b tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:00.037335 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-7eb53ee1-25bb-469d-91f3-4b8c8abc140b tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:00.259250 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-a07a2771-5d99-42e9-8fbd-2729206706e0 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:33:00.260256 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-a07a2771-5d99-42e9-8fbd-2729206706e0 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: e0250d7d-3766-4555-a9af-2429afad53bf] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:33:00.277546 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a07a2771-5d99-42e9-8fbd-2729206706e0 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:00.279921 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a07a2771-5d99-42e9-8fbd-2729206706e0 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:00.281155 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a07a2771-5d99-42e9-8fbd-2729206706e0 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:00.283283 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a07a2771-5d99-42e9-8fbd-2729206706e0 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:00.465719 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-7eb53ee1-25bb-469d-91f3-4b8c8abc140b tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1589968f375946a38e82ec484afc837f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c62c1f3c54f568abdac37360ab457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:33:00.478824 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-7eb53ee1-25bb-469d-91f3-4b8c8abc140b tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "GET /compute/v2.1/servers/e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7" status: 200 len: 1517 microversion: 2.1 time: 0.455203 May 19 21:33:00.482189 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 50/110] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:33:00 2022] GET /compute/v2.1/servers/e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7 => generated 1517 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:33:00.507476 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-b467a5ef-d6cf-4e12-86a7-26d3f75c524c tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:33:00.508867 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-b467a5ef-d6cf-4e12-86a7-26d3f75c524c tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:33:00.528108 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-b467a5ef-d6cf-4e12-86a7-26d3f75c524c tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:00.529060 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-b467a5ef-d6cf-4e12-86a7-26d3f75c524c tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:00.530439 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-b467a5ef-d6cf-4e12-86a7-26d3f75c524c tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:00.531024 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-b467a5ef-d6cf-4e12-86a7-26d3f75c524c tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:00.605549 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.objects.instance [None req-b467a5ef-d6cf-4e12-86a7-26d3f75c524c tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lazy-loading 'flavor' on Instance uuid e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7 {{(pid=124349) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 21:33:00.801020 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-a07a2771-5d99-42e9-8fbd-2729206706e0 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:33:00.817295 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-a07a2771-5d99-42e9-8fbd-2729206706e0 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:33:00.820292 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-a07a2771-5d99-42e9-8fbd-2729206706e0 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:33:00.824943 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-a07a2771-5d99-42e9-8fbd-2729206706e0 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf" status: 200 len: 1406 microversion: 2.20 time: 0.570999 May 19 21:33:00.826086 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 61/111] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:33:00 2022] GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf => generated 1406 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 21:33:00.892934 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-b467a5ef-d6cf-4e12-86a7-26d3f75c524c tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "POST /compute/v2.1/servers/e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7/action" status: 200 len: 32 microversion: 2.1 time: 0.397360 May 19 21:33:00.901391 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 51/112] 10.222.0.65 () {60 vars in 1277 bytes} [Thu May 19 21:33:00 2022] POST /compute/v2.1/servers/e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7/action => generated 32 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 21:33:00.906055 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-483b2bb3-fa92-4af3-9d30-6fea391fff9f tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:33:00.906696 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-483b2bb3-fa92-4af3-9d30-6fea391fff9f tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:33:00.934613 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-483b2bb3-fa92-4af3-9d30-6fea391fff9f tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:00.935075 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-483b2bb3-fa92-4af3-9d30-6fea391fff9f tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:00.940273 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-483b2bb3-fa92-4af3-9d30-6fea391fff9f tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:00.949568 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-483b2bb3-fa92-4af3-9d30-6fea391fff9f tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:00.994032 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-de4442fd-7972-4622-95d2-c72ce86f19e5 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:33:00.995315 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-de4442fd-7972-4622-95d2-c72ce86f19e5 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] [instance: a392a14d-152c-467f-8031-a4bb8e36e5bb] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:33:01.014770 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-de4442fd-7972-4622-95d2-c72ce86f19e5 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:01.021045 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-de4442fd-7972-4622-95d2-c72ce86f19e5 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:01.026922 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-de4442fd-7972-4622-95d2-c72ce86f19e5 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:01.027775 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-de4442fd-7972-4622-95d2-c72ce86f19e5 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:01.235159 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-de4442fd-7972-4622-95d2-c72ce86f19e5 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d16feb169ac46f7983a6b8045de77c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f5916770e9b443489fe7aa76d663fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:33:01.245000 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-de4442fd-7972-4622-95d2-c72ce86f19e5 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] 10.222.0.65 "GET /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb" status: 200 len: 1362 microversion: 2.1 time: 0.256748 May 19 21:33:01.246585 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 52/113] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:33:00 2022] GET /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb => generated 1362 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:33:01.479090 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-483b2bb3-fa92-4af3-9d30-6fea391fff9f tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1589968f375946a38e82ec484afc837f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c62c1f3c54f568abdac37360ab457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:33:01.490103 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-483b2bb3-fa92-4af3-9d30-6fea391fff9f tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "GET /compute/v2.1/servers/e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7" status: 200 len: 1523 microversion: 2.1 time: 0.588948 May 19 21:33:01.492600 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 62/114] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:33:00 2022] GET /compute/v2.1/servers/e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7 => generated 1523 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:33:01.846361 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-cdd2c81e-8f0d-4ebd-a1b2-38a492e96b1b tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:33:01.847877 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-cdd2c81e-8f0d-4ebd-a1b2-38a492e96b1b tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: e0250d7d-3766-4555-a9af-2429afad53bf] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:33:01.866399 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-cdd2c81e-8f0d-4ebd-a1b2-38a492e96b1b tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:01.867179 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-cdd2c81e-8f0d-4ebd-a1b2-38a492e96b1b tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:01.868272 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-cdd2c81e-8f0d-4ebd-a1b2-38a492e96b1b tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:01.869437 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-cdd2c81e-8f0d-4ebd-a1b2-38a492e96b1b tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:02.072937 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-cdd2c81e-8f0d-4ebd-a1b2-38a492e96b1b tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:33:02.081057 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-cdd2c81e-8f0d-4ebd-a1b2-38a492e96b1b tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:33:02.082940 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-cdd2c81e-8f0d-4ebd-a1b2-38a492e96b1b tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:33:02.084071 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-cdd2c81e-8f0d-4ebd-a1b2-38a492e96b1b tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf" status: 200 len: 1406 microversion: 2.20 time: 0.243901 May 19 21:33:02.084633 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 53/115] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:33:01 2022] GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf => generated 1406 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:33:02.265006 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-87cfae1e-a20c-40b3-8579-3832344c1a57 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:33:02.267064 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-87cfae1e-a20c-40b3-8579-3832344c1a57 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] [instance: a392a14d-152c-467f-8031-a4bb8e36e5bb] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:33:02.281837 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-87cfae1e-a20c-40b3-8579-3832344c1a57 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:02.282558 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-87cfae1e-a20c-40b3-8579-3832344c1a57 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:02.284257 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-87cfae1e-a20c-40b3-8579-3832344c1a57 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:02.284851 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-87cfae1e-a20c-40b3-8579-3832344c1a57 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:02.376273 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [req-013636fe-f8e0-4961-8aa4-31f69377fe1f req-9bc89f51-c3f9-457c-ba81-ef674c0268f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0250d7d-3766-4555-a9af-2429afad53bf", "name": "network-vif-plugged", "status": "completed", "tag": "7fe0112e-1449-4e73-9fa1-f6d3a33168d8"}]} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:33:02.398890 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-013636fe-f8e0-4961-8aa4-31f69377fe1f req-9bc89f51-c3f9-457c-ba81-ef674c0268f8 service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:02.399530 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-013636fe-f8e0-4961-8aa4-31f69377fe1f req-9bc89f51-c3f9-457c-ba81-ef674c0268f8 service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:02.425245 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.compute.server_external_events [req-013636fe-f8e0-4961-8aa4-31f69377fe1f req-9bc89f51-c3f9-457c-ba81-ef674c0268f8 service nova] Creating event network-vif-plugged:7fe0112e-1449-4e73-9fa1-f6d3a33168d8 for instance e0250d7d-3766-4555-a9af-2429afad53bf on hv-cinder-83563 May 19 21:33:02.450642 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [req-013636fe-f8e0-4961-8aa4-31f69377fe1f req-9bc89f51-c3f9-457c-ba81-ef674c0268f8 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079859 May 19 21:33:02.451251 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 54/116] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 21:33:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 21:33:02.510966 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-fb237127-3183-416b-89bb-b05c56751ce3 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:33:02.511920 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-fb237127-3183-416b-89bb-b05c56751ce3 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:33:02.521619 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-fb237127-3183-416b-89bb-b05c56751ce3 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:02.522132 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-fb237127-3183-416b-89bb-b05c56751ce3 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:02.523039 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-fb237127-3183-416b-89bb-b05c56751ce3 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:02.523528 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-fb237127-3183-416b-89bb-b05c56751ce3 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:02.535856 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-87cfae1e-a20c-40b3-8579-3832344c1a57 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d16feb169ac46f7983a6b8045de77c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f5916770e9b443489fe7aa76d663fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:33:02.560620 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-87cfae1e-a20c-40b3-8579-3832344c1a57 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] 10.222.0.65 "GET /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb" status: 200 len: 1362 microversion: 2.1 time: 0.300152 May 19 21:33:02.560620 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 63/117] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:33:02 2022] GET /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb => generated 1362 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:33:02.889754 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-fb237127-3183-416b-89bb-b05c56751ce3 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1589968f375946a38e82ec484afc837f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c62c1f3c54f568abdac37360ab457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:33:02.900235 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-fb237127-3183-416b-89bb-b05c56751ce3 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "GET /compute/v2.1/servers/e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7" status: 200 len: 1523 microversion: 2.1 time: 0.394140 May 19 21:33:02.909496 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 55/118] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:33:02 2022] GET /compute/v2.1/servers/e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7 => generated 1523 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 21:33:03.106734 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-ce617cb6-9438-4e4a-bfdd-0525b66f706c tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:33:03.107819 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-ce617cb6-9438-4e4a-bfdd-0525b66f706c tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: e0250d7d-3766-4555-a9af-2429afad53bf] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:33:03.114837 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ce617cb6-9438-4e4a-bfdd-0525b66f706c tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:03.115322 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ce617cb6-9438-4e4a-bfdd-0525b66f706c tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:03.116114 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ce617cb6-9438-4e4a-bfdd-0525b66f706c tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:03.116556 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ce617cb6-9438-4e4a-bfdd-0525b66f706c tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:03.267068 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-ce617cb6-9438-4e4a-bfdd-0525b66f706c tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:33:03.280388 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-ce617cb6-9438-4e4a-bfdd-0525b66f706c tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:33:03.280388 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-ce617cb6-9438-4e4a-bfdd-0525b66f706c tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:33:03.280388 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-ce617cb6-9438-4e4a-bfdd-0525b66f706c tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf" status: 200 len: 1406 microversion: 2.20 time: 0.179266 May 19 21:33:03.291293 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 64/119] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:33:03 2022] GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf => generated 1406 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:33:03.577056 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-2db4f8ea-9330-4b1c-83d7-82c14722a15b tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:33:03.577764 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-2db4f8ea-9330-4b1c-83d7-82c14722a15b tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] [instance: a392a14d-152c-467f-8031-a4bb8e36e5bb] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:33:03.584411 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-2db4f8ea-9330-4b1c-83d7-82c14722a15b tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:03.587231 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-2db4f8ea-9330-4b1c-83d7-82c14722a15b tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:03.588084 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-2db4f8ea-9330-4b1c-83d7-82c14722a15b tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:03.588677 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-2db4f8ea-9330-4b1c-83d7-82c14722a15b tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:03.764796 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-2db4f8ea-9330-4b1c-83d7-82c14722a15b tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d16feb169ac46f7983a6b8045de77c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f5916770e9b443489fe7aa76d663fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:33:03.773178 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-2db4f8ea-9330-4b1c-83d7-82c14722a15b tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] 10.222.0.65 "GET /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb" status: 200 len: 1362 microversion: 2.1 time: 0.200405 May 19 21:33:03.782847 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 56/120] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:33:03 2022] GET /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb => generated 1362 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:33:03.920192 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-24c00f2b-10f9-47d3-b1b2-9ea159b13185 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:33:03.920876 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-24c00f2b-10f9-47d3-b1b2-9ea159b13185 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:33:03.927709 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-24c00f2b-10f9-47d3-b1b2-9ea159b13185 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:03.928428 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-24c00f2b-10f9-47d3-b1b2-9ea159b13185 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:03.929423 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-24c00f2b-10f9-47d3-b1b2-9ea159b13185 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:03.930067 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-24c00f2b-10f9-47d3-b1b2-9ea159b13185 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:04.108096 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-24c00f2b-10f9-47d3-b1b2-9ea159b13185 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1589968f375946a38e82ec484afc837f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c62c1f3c54f568abdac37360ab457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:33:04.118784 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-24c00f2b-10f9-47d3-b1b2-9ea159b13185 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "GET /compute/v2.1/servers/e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7" status: 200 len: 1523 microversion: 2.1 time: 0.202924 May 19 21:33:04.119661 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 65/121] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:33:03 2022] GET /compute/v2.1/servers/e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7 => generated 1523 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:33:04.300501 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-aa07e407-ce34-462e-b8cb-6bd0b2e3deab tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:33:04.301362 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-aa07e407-ce34-462e-b8cb-6bd0b2e3deab tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: e0250d7d-3766-4555-a9af-2429afad53bf] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:33:04.309470 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-aa07e407-ce34-462e-b8cb-6bd0b2e3deab tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:04.310882 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-aa07e407-ce34-462e-b8cb-6bd0b2e3deab tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:04.311959 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-aa07e407-ce34-462e-b8cb-6bd0b2e3deab tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:04.312500 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-aa07e407-ce34-462e-b8cb-6bd0b2e3deab tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:04.568229 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-aa07e407-ce34-462e-b8cb-6bd0b2e3deab tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:33:04.579427 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-aa07e407-ce34-462e-b8cb-6bd0b2e3deab tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:33:04.582280 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-aa07e407-ce34-462e-b8cb-6bd0b2e3deab tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:33:04.583854 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-aa07e407-ce34-462e-b8cb-6bd0b2e3deab tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf" status: 200 len: 1406 microversion: 2.20 time: 0.288762 May 19 21:33:04.585522 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 57/122] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:33:04 2022] GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf => generated 1406 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:33:04.792789 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-fb92636d-8ff6-4ccc-b4f9-89a7125876ae tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:33:04.793619 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-fb92636d-8ff6-4ccc-b4f9-89a7125876ae tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] [instance: a392a14d-152c-467f-8031-a4bb8e36e5bb] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:33:04.800867 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-fb92636d-8ff6-4ccc-b4f9-89a7125876ae tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:04.801325 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-fb92636d-8ff6-4ccc-b4f9-89a7125876ae tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:04.802479 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-fb92636d-8ff6-4ccc-b4f9-89a7125876ae tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:04.803040 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-fb92636d-8ff6-4ccc-b4f9-89a7125876ae tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:05.129791 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-fb92636d-8ff6-4ccc-b4f9-89a7125876ae tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d16feb169ac46f7983a6b8045de77c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f5916770e9b443489fe7aa76d663fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:33:05.139485 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-fb92636d-8ff6-4ccc-b4f9-89a7125876ae tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] 10.222.0.65 "GET /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb" status: 200 len: 1362 microversion: 2.1 time: 0.352294 May 19 21:33:05.140058 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 66/123] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:33:04 2022] GET /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb => generated 1362 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:33:05.147241 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-13ee5446-abb3-4fee-9547-f1eeeaa000b1 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:33:05.147981 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-13ee5446-abb3-4fee-9547-f1eeeaa000b1 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:33:05.154959 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-13ee5446-abb3-4fee-9547-f1eeeaa000b1 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:05.155456 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-13ee5446-abb3-4fee-9547-f1eeeaa000b1 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:05.156241 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-13ee5446-abb3-4fee-9547-f1eeeaa000b1 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:05.156667 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-13ee5446-abb3-4fee-9547-f1eeeaa000b1 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:05.357842 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-13ee5446-abb3-4fee-9547-f1eeeaa000b1 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1589968f375946a38e82ec484afc837f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c62c1f3c54f568abdac37360ab457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:33:05.371560 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-13ee5446-abb3-4fee-9547-f1eeeaa000b1 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "GET /compute/v2.1/servers/e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7" status: 200 len: 1523 microversion: 2.1 time: 0.238532 May 19 21:33:05.372330 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 58/124] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:33:05 2022] GET /compute/v2.1/servers/e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7 => generated 1523 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 21:33:05.607125 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-a53b8517-a155-4f56-bc97-4546be8f3185 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:33:05.608144 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-a53b8517-a155-4f56-bc97-4546be8f3185 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: e0250d7d-3766-4555-a9af-2429afad53bf] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:33:05.627090 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a53b8517-a155-4f56-bc97-4546be8f3185 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:05.628290 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a53b8517-a155-4f56-bc97-4546be8f3185 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:05.629837 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a53b8517-a155-4f56-bc97-4546be8f3185 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:05.631423 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a53b8517-a155-4f56-bc97-4546be8f3185 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:05.665679 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:33:05.873807 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-a53b8517-a155-4f56-bc97-4546be8f3185 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:33:05.883425 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-a53b8517-a155-4f56-bc97-4546be8f3185 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:33:05.886044 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-a53b8517-a155-4f56-bc97-4546be8f3185 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:33:05.887401 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-a53b8517-a155-4f56-bc97-4546be8f3185 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf" status: 200 len: 1406 microversion: 2.20 time: 0.286913 May 19 21:33:05.888557 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 67/125] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:33:05 2022] GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf => generated 1406 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:33:06.156871 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-a7784595-5e96-47db-84dc-a9153c5f5304 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:33:06.157482 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-a7784595-5e96-47db-84dc-a9153c5f5304 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] [instance: a392a14d-152c-467f-8031-a4bb8e36e5bb] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:33:06.167821 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a7784595-5e96-47db-84dc-a9153c5f5304 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:06.168487 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a7784595-5e96-47db-84dc-a9153c5f5304 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:06.169401 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a7784595-5e96-47db-84dc-a9153c5f5304 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:06.169849 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a7784595-5e96-47db-84dc-a9153c5f5304 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:06.389235 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-dcb57dac-4829-4354-beef-8821245418a9 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:33:06.391291 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-a7784595-5e96-47db-84dc-a9153c5f5304 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d16feb169ac46f7983a6b8045de77c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f5916770e9b443489fe7aa76d663fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:33:06.394800 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-dcb57dac-4829-4354-beef-8821245418a9 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:33:06.403110 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-a7784595-5e96-47db-84dc-a9153c5f5304 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] 10.222.0.65 "GET /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb" status: 200 len: 1362 microversion: 2.1 time: 0.250286 May 19 21:33:06.412068 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 59/126] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:33:06 2022] GET /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb => generated 1362 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:33:06.421146 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-dcb57dac-4829-4354-beef-8821245418a9 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:06.422305 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-dcb57dac-4829-4354-beef-8821245418a9 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:06.425157 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-dcb57dac-4829-4354-beef-8821245418a9 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:06.426345 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-dcb57dac-4829-4354-beef-8821245418a9 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:06.678880 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-dcb57dac-4829-4354-beef-8821245418a9 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1589968f375946a38e82ec484afc837f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c62c1f3c54f568abdac37360ab457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:33:06.688911 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-dcb57dac-4829-4354-beef-8821245418a9 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "GET /compute/v2.1/servers/e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7" status: 200 len: 1523 microversion: 2.1 time: 0.303519 May 19 21:33:06.690637 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 68/127] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:33:06 2022] GET /compute/v2.1/servers/e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7 => generated 1523 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:33:06.905623 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-694800f3-09da-45cc-8ebe-2f98f0038ff5 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:33:06.906260 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-694800f3-09da-45cc-8ebe-2f98f0038ff5 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: e0250d7d-3766-4555-a9af-2429afad53bf] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:33:06.916768 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-694800f3-09da-45cc-8ebe-2f98f0038ff5 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:06.917239 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-694800f3-09da-45cc-8ebe-2f98f0038ff5 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:06.918053 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-694800f3-09da-45cc-8ebe-2f98f0038ff5 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:06.918515 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-694800f3-09da-45cc-8ebe-2f98f0038ff5 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:07.099004 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-694800f3-09da-45cc-8ebe-2f98f0038ff5 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:33:07.116648 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-694800f3-09da-45cc-8ebe-2f98f0038ff5 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:33:07.119615 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-694800f3-09da-45cc-8ebe-2f98f0038ff5 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:33:07.120989 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-694800f3-09da-45cc-8ebe-2f98f0038ff5 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf" status: 200 len: 1406 microversion: 2.20 time: 0.219415 May 19 21:33:07.121735 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 60/128] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:33:06 2022] GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf => generated 1406 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:33:07.457578 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-7c4d310d-9d3b-4ef0-aa16-66fcd18fce94 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:33:07.460706 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-7c4d310d-9d3b-4ef0-aa16-66fcd18fce94 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] [instance: a392a14d-152c-467f-8031-a4bb8e36e5bb] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:33:07.474052 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7c4d310d-9d3b-4ef0-aa16-66fcd18fce94 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:07.474659 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7c4d310d-9d3b-4ef0-aa16-66fcd18fce94 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:07.475527 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7c4d310d-9d3b-4ef0-aa16-66fcd18fce94 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:07.476049 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7c4d310d-9d3b-4ef0-aa16-66fcd18fce94 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:07.629342 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-7c4d310d-9d3b-4ef0-aa16-66fcd18fce94 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d16feb169ac46f7983a6b8045de77c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f5916770e9b443489fe7aa76d663fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:33:07.637342 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-7c4d310d-9d3b-4ef0-aa16-66fcd18fce94 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] 10.222.0.65 "GET /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb" status: 200 len: 1362 microversion: 2.1 time: 0.212052 May 19 21:33:07.637920 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 69/129] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:33:07 2022] GET /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb => generated 1362 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:33:07.709513 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-faa5e7dc-fae8-4902-99e5-979ba1133fad tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:33:07.710809 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-faa5e7dc-fae8-4902-99e5-979ba1133fad tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:33:07.718223 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-faa5e7dc-fae8-4902-99e5-979ba1133fad tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:07.719054 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-faa5e7dc-fae8-4902-99e5-979ba1133fad tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:07.720256 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-faa5e7dc-fae8-4902-99e5-979ba1133fad tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:07.720861 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-faa5e7dc-fae8-4902-99e5-979ba1133fad tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:07.912452 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-faa5e7dc-fae8-4902-99e5-979ba1133fad tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1589968f375946a38e82ec484afc837f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c62c1f3c54f568abdac37360ab457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:33:07.922655 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-faa5e7dc-fae8-4902-99e5-979ba1133fad tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "GET /compute/v2.1/servers/e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7" status: 200 len: 1523 microversion: 2.1 time: 0.216899 May 19 21:33:07.927389 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 61/130] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:33:07 2022] GET /compute/v2.1/servers/e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7 => generated 1523 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:33:08.156084 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-f7db5421-bbb5-4d86-96b1-0b9532e4d29c tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:33:08.156697 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-f7db5421-bbb5-4d86-96b1-0b9532e4d29c tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: e0250d7d-3766-4555-a9af-2429afad53bf] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:33:08.162889 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:33:08.165270 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f7db5421-bbb5-4d86-96b1-0b9532e4d29c tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:08.165897 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f7db5421-bbb5-4d86-96b1-0b9532e4d29c tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:08.166899 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f7db5421-bbb5-4d86-96b1-0b9532e4d29c tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:08.167486 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f7db5421-bbb5-4d86-96b1-0b9532e4d29c tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:08.349073 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-f7db5421-bbb5-4d86-96b1-0b9532e4d29c tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:33:08.362363 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-f7db5421-bbb5-4d86-96b1-0b9532e4d29c tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:33:08.364138 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-f7db5421-bbb5-4d86-96b1-0b9532e4d29c tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:33:08.366222 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-f7db5421-bbb5-4d86-96b1-0b9532e4d29c tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf" status: 200 len: 1599 microversion: 2.20 time: 0.222754 May 19 21:33:08.367357 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 70/131] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:33:08 2022] GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf => generated 1599 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:33:08.389482 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-1f27c6b1-a25b-4487-8731-30bf53141bb6 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:33:08.390047 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-1f27c6b1-a25b-4487-8731-30bf53141bb6 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: e0250d7d-3766-4555-a9af-2429afad53bf] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:33:08.399337 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1f27c6b1-a25b-4487-8731-30bf53141bb6 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:08.399787 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1f27c6b1-a25b-4487-8731-30bf53141bb6 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:08.400577 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1f27c6b1-a25b-4487-8731-30bf53141bb6 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:08.401012 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1f27c6b1-a25b-4487-8731-30bf53141bb6 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:08.486897 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [req-86df8771-6f7a-4f46-adb9-ee8648fb4e8d req-25c0d76d-a5b7-4762-b6d0-ddf2b0c5dc65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a392a14d-152c-467f-8031-a4bb8e36e5bb", "name": "network-vif-plugged", "status": "completed", "tag": "273956f8-6ada-4c24-9d33-e37b581a5bb1"}]} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:33:08.502975 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-86df8771-6f7a-4f46-adb9-ee8648fb4e8d req-25c0d76d-a5b7-4762-b6d0-ddf2b0c5dc65 service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:08.503604 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-86df8771-6f7a-4f46-adb9-ee8648fb4e8d req-25c0d76d-a5b7-4762-b6d0-ddf2b0c5dc65 service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:08.551542 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.compute.server_external_events [req-86df8771-6f7a-4f46-adb9-ee8648fb4e8d req-25c0d76d-a5b7-4762-b6d0-ddf2b0c5dc65 service nova] Creating event network-vif-plugged:273956f8-6ada-4c24-9d33-e37b581a5bb1 for instance a392a14d-152c-467f-8031-a4bb8e36e5bb on hv-cinder-83563 May 19 21:33:08.565272 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [req-86df8771-6f7a-4f46-adb9-ee8648fb4e8d req-25c0d76d-a5b7-4762-b6d0-ddf2b0c5dc65 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082093 May 19 21:33:08.565899 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 71/132] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 21:33:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 21:33:08.586439 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-1f27c6b1-a25b-4487-8731-30bf53141bb6 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.202365 May 19 21:33:08.588533 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 62/133] 10.222.0.65 () {60 vars in 1315 bytes} [Thu May 19 21:33:08 2022] GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf/os-interface => generated 285 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 21:33:08.655675 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-7af93364-4432-4d94-ba7d-4cfe087a644b tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:33:08.656781 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-7af93364-4432-4d94-ba7d-4cfe087a644b tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] [instance: a392a14d-152c-467f-8031-a4bb8e36e5bb] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:33:08.664747 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7af93364-4432-4d94-ba7d-4cfe087a644b tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:08.665187 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7af93364-4432-4d94-ba7d-4cfe087a644b tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:08.666137 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7af93364-4432-4d94-ba7d-4cfe087a644b tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:08.666622 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7af93364-4432-4d94-ba7d-4cfe087a644b tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:08.833678 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-7af93364-4432-4d94-ba7d-4cfe087a644b tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d16feb169ac46f7983a6b8045de77c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f5916770e9b443489fe7aa76d663fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:33:08.842973 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-7af93364-4432-4d94-ba7d-4cfe087a644b tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] 10.222.0.65 "GET /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb" status: 200 len: 1362 microversion: 2.1 time: 0.191646 May 19 21:33:08.843569 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 72/134] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:33:08 2022] GET /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb => generated 1362 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:33:08.954266 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-1be14796-6f45-4f49-85e5-723518453eb1 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:33:08.954926 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-1be14796-6f45-4f49-85e5-723518453eb1 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:33:08.978016 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1be14796-6f45-4f49-85e5-723518453eb1 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:08.978893 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1be14796-6f45-4f49-85e5-723518453eb1 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:08.980422 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1be14796-6f45-4f49-85e5-723518453eb1 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:08.981133 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1be14796-6f45-4f49-85e5-723518453eb1 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:09.440218 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-1be14796-6f45-4f49-85e5-723518453eb1 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1589968f375946a38e82ec484afc837f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c62c1f3c54f568abdac37360ab457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:33:09.450903 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-1be14796-6f45-4f49-85e5-723518453eb1 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "GET /compute/v2.1/servers/e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7" status: 200 len: 1523 microversion: 2.1 time: 0.508780 May 19 21:33:09.451499 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 63/135] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:33:08 2022] GET /compute/v2.1/servers/e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7 => generated 1523 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:33:09.758067 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-b674ea74-ec08-4bdc-be38-63ae056d21f6 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:33:09.759484 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-b674ea74-ec08-4bdc-be38-63ae056d21f6 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] [instance: c31d034b-2cf3-4518-8e50-8beda1897c20] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:33:09.771133 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b674ea74-ec08-4bdc-be38-63ae056d21f6 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:09.772896 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b674ea74-ec08-4bdc-be38-63ae056d21f6 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:09.773939 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b674ea74-ec08-4bdc-be38-63ae056d21f6 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:09.774665 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b674ea74-ec08-4bdc-be38-63ae056d21f6 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:09.820810 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-b674ea74-ec08-4bdc-be38-63ae056d21f6 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] [instance: c31d034b-2cf3-4518-8e50-8beda1897c20] Going to try to terminate instance {{(pid=124350) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 21:33:09.871761 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-598c2257-3ba4-4cb6-b2cf-80c5310de0df tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:33:09.873278 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-598c2257-3ba4-4cb6-b2cf-80c5310de0df tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] [instance: a392a14d-152c-467f-8031-a4bb8e36e5bb] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:33:09.889234 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-598c2257-3ba4-4cb6-b2cf-80c5310de0df tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:09.892162 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-598c2257-3ba4-4cb6-b2cf-80c5310de0df tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:09.895663 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-598c2257-3ba4-4cb6-b2cf-80c5310de0df tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:09.896945 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-598c2257-3ba4-4cb6-b2cf-80c5310de0df tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:10.055951 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-b674ea74-ec08-4bdc-be38-63ae056d21f6 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] 10.222.0.65 "DELETE /compute/v2.1/servers/c31d034b-2cf3-4518-8e50-8beda1897c20" status: 204 len: 0 microversion: 2.1 time: 0.302432 May 19 21:33:10.058887 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 73/136] 10.222.0.65 () {58 vars in 1238 bytes} [Thu May 19 21:33:09 2022] DELETE /compute/v2.1/servers/c31d034b-2cf3-4518-8e50-8beda1897c20 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 21:33:10.074160 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-842e4082-afcd-43e3-92b7-1703be8139d8 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:33:10.080005 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-842e4082-afcd-43e3-92b7-1703be8139d8 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] [instance: c31d034b-2cf3-4518-8e50-8beda1897c20] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:33:10.094498 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-842e4082-afcd-43e3-92b7-1703be8139d8 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:10.096651 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-842e4082-afcd-43e3-92b7-1703be8139d8 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:10.098526 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-842e4082-afcd-43e3-92b7-1703be8139d8 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:10.099414 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-842e4082-afcd-43e3-92b7-1703be8139d8 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:10.376542 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-842e4082-afcd-43e3-92b7-1703be8139d8 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc570204a2bb4889889a67850dd1d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6166dc89ce0545c1bbb8adb947034e79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:33:10.389388 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-842e4082-afcd-43e3-92b7-1703be8139d8 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] 10.222.0.65 "GET /compute/v2.1/servers/c31d034b-2cf3-4518-8e50-8beda1897c20" status: 200 len: 1553 microversion: 2.1 time: 0.325347 May 19 21:33:10.407182 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 74/137] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:33:10 2022] GET /compute/v2.1/servers/c31d034b-2cf3-4518-8e50-8beda1897c20 => generated 1553 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:33:10.425425 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-598c2257-3ba4-4cb6-b2cf-80c5310de0df tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d16feb169ac46f7983a6b8045de77c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f5916770e9b443489fe7aa76d663fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:33:10.429745 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:33:10.451270 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-598c2257-3ba4-4cb6-b2cf-80c5310de0df tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] 10.222.0.65 "GET /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb" status: 200 len: 1362 microversion: 2.1 time: 0.588715 May 19 21:33:10.453023 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 64/138] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:33:09 2022] GET /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb => generated 1362 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 21:33:10.473917 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-21a8988e-d855-4fac-9fce-b887db205444 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:33:10.478339 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-21a8988e-d855-4fac-9fce-b887db205444 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:33:10.497553 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-21a8988e-d855-4fac-9fce-b887db205444 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:10.501857 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-21a8988e-d855-4fac-9fce-b887db205444 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:10.507454 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-21a8988e-d855-4fac-9fce-b887db205444 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:10.508292 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-21a8988e-d855-4fac-9fce-b887db205444 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:10.779887 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-21a8988e-d855-4fac-9fce-b887db205444 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1589968f375946a38e82ec484afc837f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c62c1f3c54f568abdac37360ab457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:33:10.791227 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-21a8988e-d855-4fac-9fce-b887db205444 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "GET /compute/v2.1/servers/e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7" status: 200 len: 1523 microversion: 2.1 time: 0.325202 May 19 21:33:10.803515 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 75/139] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:33:10 2022] GET /compute/v2.1/servers/e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7 => generated 1523 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:33:11.248512 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [req-83639722-e003-4978-92cb-0d7e153e6720 req-dd3987f4-267d-46e4-8ea4-68994996c0e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0250d7d-3766-4555-a9af-2429afad53bf", "tag": "7fe0112e-1449-4e73-9fa1-f6d3a33168d8"}]} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:33:11.260686 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-83639722-e003-4978-92cb-0d7e153e6720 req-dd3987f4-267d-46e4-8ea4-68994996c0e7 service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:11.261542 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-83639722-e003-4978-92cb-0d7e153e6720 req-dd3987f4-267d-46e4-8ea4-68994996c0e7 service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:11.279576 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.compute.server_external_events [req-83639722-e003-4978-92cb-0d7e153e6720 req-dd3987f4-267d-46e4-8ea4-68994996c0e7 service nova] Creating event network-changed:7fe0112e-1449-4e73-9fa1-f6d3a33168d8 for instance e0250d7d-3766-4555-a9af-2429afad53bf on hv-cinder-83563 May 19 21:33:11.286066 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [req-83639722-e003-4978-92cb-0d7e153e6720 req-dd3987f4-267d-46e4-8ea4-68994996c0e7 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041680 May 19 21:33:11.291534 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 65/140] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 21:33:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 21:33:11.411063 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-ccec55b1-59d0-42fc-96c8-2fde707dc958 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:33:11.411782 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-ccec55b1-59d0-42fc-96c8-2fde707dc958 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] [instance: c31d034b-2cf3-4518-8e50-8beda1897c20] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:33:11.422062 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ccec55b1-59d0-42fc-96c8-2fde707dc958 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:11.422531 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ccec55b1-59d0-42fc-96c8-2fde707dc958 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:11.423485 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ccec55b1-59d0-42fc-96c8-2fde707dc958 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:11.423768 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ccec55b1-59d0-42fc-96c8-2fde707dc958 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:11.476204 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-0078ca51-1b72-4859-987a-e3e8da2d7ff5 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:33:11.477646 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-0078ca51-1b72-4859-987a-e3e8da2d7ff5 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] [instance: a392a14d-152c-467f-8031-a4bb8e36e5bb] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:33:11.498133 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-0078ca51-1b72-4859-987a-e3e8da2d7ff5 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:11.499115 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-0078ca51-1b72-4859-987a-e3e8da2d7ff5 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:11.503353 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-0078ca51-1b72-4859-987a-e3e8da2d7ff5 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:11.506105 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-0078ca51-1b72-4859-987a-e3e8da2d7ff5 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:11.706039 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-0078ca51-1b72-4859-987a-e3e8da2d7ff5 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d16feb169ac46f7983a6b8045de77c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f5916770e9b443489fe7aa76d663fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:33:11.714043 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-0078ca51-1b72-4859-987a-e3e8da2d7ff5 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] 10.222.0.65 "GET /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb" status: 200 len: 1362 microversion: 2.1 time: 0.246121 May 19 21:33:11.723878 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 66/141] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:33:11 2022] GET /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb => generated 1362 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:33:11.724101 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-ccec55b1-59d0-42fc-96c8-2fde707dc958 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc570204a2bb4889889a67850dd1d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6166dc89ce0545c1bbb8adb947034e79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:33:11.732959 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-ccec55b1-59d0-42fc-96c8-2fde707dc958 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] 10.222.0.65 "GET /compute/v2.1/servers/c31d034b-2cf3-4518-8e50-8beda1897c20" status: 200 len: 1553 microversion: 2.1 time: 0.327840 May 19 21:33:11.733915 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 76/142] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:33:11 2022] GET /compute/v2.1/servers/c31d034b-2cf3-4518-8e50-8beda1897c20 => generated 1553 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:33:11.810032 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-2828090e-0035-48b5-9cd4-32a62e6625fc tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:33:11.811028 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-2828090e-0035-48b5-9cd4-32a62e6625fc tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:33:11.822284 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-2828090e-0035-48b5-9cd4-32a62e6625fc tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:11.823811 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-2828090e-0035-48b5-9cd4-32a62e6625fc tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:11.825254 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-2828090e-0035-48b5-9cd4-32a62e6625fc tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:11.826049 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-2828090e-0035-48b5-9cd4-32a62e6625fc tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:12.062173 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-2828090e-0035-48b5-9cd4-32a62e6625fc tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1589968f375946a38e82ec484afc837f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c62c1f3c54f568abdac37360ab457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:33:12.088640 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-2828090e-0035-48b5-9cd4-32a62e6625fc tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "GET /compute/v2.1/servers/e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7" status: 200 len: 1523 microversion: 2.1 time: 0.273095 May 19 21:33:12.089584 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 67/143] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:33:11 2022] GET /compute/v2.1/servers/e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7 => generated 1523 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:33:12.739361 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-c93cf974-78a9-43e8-aea9-358a5ff68ca6 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:33:12.742466 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-c93cf974-78a9-43e8-aea9-358a5ff68ca6 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] [instance: a392a14d-152c-467f-8031-a4bb8e36e5bb] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:33:12.760874 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-56e256ec-4a3e-4b82-973a-bd8e3af3da65 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:33:12.763775 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-56e256ec-4a3e-4b82-973a-bd8e3af3da65 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] [instance: c31d034b-2cf3-4518-8e50-8beda1897c20] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:33:12.777326 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c93cf974-78a9-43e8-aea9-358a5ff68ca6 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:12.779301 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c93cf974-78a9-43e8-aea9-358a5ff68ca6 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:12.795484 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c93cf974-78a9-43e8-aea9-358a5ff68ca6 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:12.796638 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c93cf974-78a9-43e8-aea9-358a5ff68ca6 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:12.811553 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-56e256ec-4a3e-4b82-973a-bd8e3af3da65 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:12.814333 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-56e256ec-4a3e-4b82-973a-bd8e3af3da65 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:12.816158 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-56e256ec-4a3e-4b82-973a-bd8e3af3da65 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:12.823808 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-56e256ec-4a3e-4b82-973a-bd8e3af3da65 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:13.248952 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-56e256ec-4a3e-4b82-973a-bd8e3af3da65 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc570204a2bb4889889a67850dd1d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6166dc89ce0545c1bbb8adb947034e79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:33:13.261032 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-56e256ec-4a3e-4b82-973a-bd8e3af3da65 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] 10.222.0.65 "GET /compute/v2.1/servers/c31d034b-2cf3-4518-8e50-8beda1897c20" status: 200 len: 1553 microversion: 2.1 time: 0.507536 May 19 21:33:13.269664 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 68/144] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:33:12 2022] GET /compute/v2.1/servers/c31d034b-2cf3-4518-8e50-8beda1897c20 => generated 1553 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:33:13.281166 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-ef2047a7-c073-4332-96f5-8763e8a1a975 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:33:13.285715 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-ef2047a7-c073-4332-96f5-8763e8a1a975 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:33:13.297165 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ef2047a7-c073-4332-96f5-8763e8a1a975 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:13.301334 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ef2047a7-c073-4332-96f5-8763e8a1a975 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:13.302519 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ef2047a7-c073-4332-96f5-8763e8a1a975 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:13.303105 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ef2047a7-c073-4332-96f5-8763e8a1a975 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:13.577756 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-c93cf974-78a9-43e8-aea9-358a5ff68ca6 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d16feb169ac46f7983a6b8045de77c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f5916770e9b443489fe7aa76d663fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:33:13.593676 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-c93cf974-78a9-43e8-aea9-358a5ff68ca6 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] 10.222.0.65 "GET /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb" status: 200 len: 1362 microversion: 2.1 time: 0.863470 May 19 21:33:13.616691 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 77/145] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:33:12 2022] GET /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb => generated 1362 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 21:33:13.960954 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-ef2047a7-c073-4332-96f5-8763e8a1a975 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1589968f375946a38e82ec484afc837f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c62c1f3c54f568abdac37360ab457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:33:13.974178 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-ef2047a7-c073-4332-96f5-8763e8a1a975 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "GET /compute/v2.1/servers/e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7" status: 200 len: 1523 microversion: 2.1 time: 0.702072 May 19 21:33:13.974953 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 69/146] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:33:13 2022] GET /compute/v2.1/servers/e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7 => generated 1523 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:33:14.290908 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-4533f883-6b6f-4979-8ec6-d30187912649 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:33:14.292938 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-4533f883-6b6f-4979-8ec6-d30187912649 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] [instance: c31d034b-2cf3-4518-8e50-8beda1897c20] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:33:14.324017 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4533f883-6b6f-4979-8ec6-d30187912649 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:14.327470 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4533f883-6b6f-4979-8ec6-d30187912649 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:14.332033 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4533f883-6b6f-4979-8ec6-d30187912649 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:14.336071 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4533f883-6b6f-4979-8ec6-d30187912649 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:14.640878 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-1ede5130-9572-4b18-b66a-894a5959dd64 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:33:14.642793 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-1ede5130-9572-4b18-b66a-894a5959dd64 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] [instance: a392a14d-152c-467f-8031-a4bb8e36e5bb] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:33:14.678997 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-4533f883-6b6f-4979-8ec6-d30187912649 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc570204a2bb4889889a67850dd1d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6166dc89ce0545c1bbb8adb947034e79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:33:14.690401 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-4533f883-6b6f-4979-8ec6-d30187912649 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] 10.222.0.65 "GET /compute/v2.1/servers/c31d034b-2cf3-4518-8e50-8beda1897c20" status: 200 len: 1553 microversion: 2.1 time: 0.409028 May 19 21:33:14.691185 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1ede5130-9572-4b18-b66a-894a5959dd64 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:14.691756 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1ede5130-9572-4b18-b66a-894a5959dd64 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:14.692614 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1ede5130-9572-4b18-b66a-894a5959dd64 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:14.693054 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1ede5130-9572-4b18-b66a-894a5959dd64 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:14.701482 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 78/147] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:33:14 2022] GET /compute/v2.1/servers/c31d034b-2cf3-4518-8e50-8beda1897c20 => generated 1553 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:33:14.936369 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-1ede5130-9572-4b18-b66a-894a5959dd64 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d16feb169ac46f7983a6b8045de77c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f5916770e9b443489fe7aa76d663fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:33:14.954729 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-1ede5130-9572-4b18-b66a-894a5959dd64 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] 10.222.0.65 "GET /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb" status: 200 len: 1549 microversion: 2.1 time: 0.330057 May 19 21:33:14.958926 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 70/148] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:33:14 2022] GET /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb => generated 1549 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:33:14.965595 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [req-3094a9c0-1ebb-4bba-bede-dd8d030c8e02 req-6ed5ef0b-4ff3-4386-894c-7f85cab25738 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c31d034b-2cf3-4518-8e50-8beda1897c20", "name": "network-vif-deleted", "tag": "4027ae3d-2633-4456-b298-d5add36a2a85"}]} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:33:14.984561 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-3094a9c0-1ebb-4bba-bede-dd8d030c8e02 req-6ed5ef0b-4ff3-4386-894c-7f85cab25738 service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:14.985654 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-3094a9c0-1ebb-4bba-bede-dd8d030c8e02 req-6ed5ef0b-4ff3-4386-894c-7f85cab25738 service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:15.007225 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.compute.server_external_events [req-3094a9c0-1ebb-4bba-bede-dd8d030c8e02 req-6ed5ef0b-4ff3-4386-894c-7f85cab25738 service nova] Creating event network-vif-deleted:4027ae3d-2633-4456-b298-d5add36a2a85 for instance c31d034b-2cf3-4518-8e50-8beda1897c20 on hv-cinder-83563 May 19 21:33:15.008681 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-5ddf5f08-b8be-473c-b2d9-f9090797908b tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:33:15.009855 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-5ddf5f08-b8be-473c-b2d9-f9090797908b tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] [instance: a392a14d-152c-467f-8031-a4bb8e36e5bb] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:33:15.016699 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [req-3094a9c0-1ebb-4bba-bede-dd8d030c8e02 req-6ed5ef0b-4ff3-4386-894c-7f85cab25738 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056750 May 19 21:33:15.017987 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 79/149] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 21:33:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 21:33:15.019233 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-5ddf5f08-b8be-473c-b2d9-f9090797908b tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:15.019897 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-5ddf5f08-b8be-473c-b2d9-f9090797908b tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:15.020691 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-5ddf5f08-b8be-473c-b2d9-f9090797908b tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:15.021824 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-5ddf5f08-b8be-473c-b2d9-f9090797908b tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:15.031293 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-4dd39744-7894-4b01-9356-b1af3881ed96 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:33:15.033153 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-4dd39744-7894-4b01-9356-b1af3881ed96 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:33:15.045050 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4dd39744-7894-4b01-9356-b1af3881ed96 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:15.046024 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4dd39744-7894-4b01-9356-b1af3881ed96 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:15.048244 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4dd39744-7894-4b01-9356-b1af3881ed96 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:15.049229 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4dd39744-7894-4b01-9356-b1af3881ed96 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:15.159791 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-5ddf5f08-b8be-473c-b2d9-f9090797908b tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] 10.222.0.65 "GET /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.176140 May 19 21:33:15.166965 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 71/150] 10.222.0.65 () {58 vars in 1274 bytes} [Thu May 19 21:33:14 2022] GET /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb/os-interface => generated 285 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 21:33:15.290427 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-4dd39744-7894-4b01-9356-b1af3881ed96 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1589968f375946a38e82ec484afc837f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c62c1f3c54f568abdac37360ab457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:33:15.299143 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-4dd39744-7894-4b01-9356-b1af3881ed96 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "GET /compute/v2.1/servers/e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7" status: 200 len: 1523 microversion: 2.1 time: 0.278284 May 19 21:33:15.308918 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 80/151] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:33:15 2022] GET /compute/v2.1/servers/e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7 => generated 1523 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:33:15.731763 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-a05b6d26-d5f0-4ce4-ab00-7b945017f73d tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:33:15.732600 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-a05b6d26-d5f0-4ce4-ab00-7b945017f73d tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] [instance: c31d034b-2cf3-4518-8e50-8beda1897c20] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:33:15.740400 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a05b6d26-d5f0-4ce4-ab00-7b945017f73d tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:15.740909 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a05b6d26-d5f0-4ce4-ab00-7b945017f73d tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:15.742426 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a05b6d26-d5f0-4ce4-ab00-7b945017f73d tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:15.743065 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a05b6d26-d5f0-4ce4-ab00-7b945017f73d tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:15.832133 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-a05b6d26-d5f0-4ce4-ab00-7b945017f73d tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc570204a2bb4889889a67850dd1d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6166dc89ce0545c1bbb8adb947034e79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:33:15.844832 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-a05b6d26-d5f0-4ce4-ab00-7b945017f73d tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] 10.222.0.65 "GET /compute/v2.1/servers/c31d034b-2cf3-4518-8e50-8beda1897c20" status: 200 len: 1345 microversion: 2.1 time: 0.122132 May 19 21:33:15.855801 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 72/152] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:33:15 2022] GET /compute/v2.1/servers/c31d034b-2cf3-4518-8e50-8beda1897c20 => generated 1345 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:33:16.317809 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-e3ee144d-33f0-4c4b-9ce9-8acd246678a8 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:33:16.319143 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-e3ee144d-33f0-4c4b-9ce9-8acd246678a8 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:33:16.326465 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e3ee144d-33f0-4c4b-9ce9-8acd246678a8 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:16.327250 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e3ee144d-33f0-4c4b-9ce9-8acd246678a8 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:16.328119 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e3ee144d-33f0-4c4b-9ce9-8acd246678a8 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:16.328449 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e3ee144d-33f0-4c4b-9ce9-8acd246678a8 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:16.562074 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-e3ee144d-33f0-4c4b-9ce9-8acd246678a8 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1589968f375946a38e82ec484afc837f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c62c1f3c54f568abdac37360ab457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:33:16.573367 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-e3ee144d-33f0-4c4b-9ce9-8acd246678a8 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "GET /compute/v2.1/servers/e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7" status: 200 len: 1523 microversion: 2.1 time: 0.259744 May 19 21:33:16.574007 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 81/153] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:33:16 2022] GET /compute/v2.1/servers/e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7 => generated 1523 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:33:16.862868 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-5efd74ce-d9f1-4d52-9b7a-1283e7ca4935 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:33:16.866568 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-5efd74ce-d9f1-4d52-9b7a-1283e7ca4935 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] [instance: c31d034b-2cf3-4518-8e50-8beda1897c20] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:33:16.873675 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-5efd74ce-d9f1-4d52-9b7a-1283e7ca4935 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:16.874229 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-5efd74ce-d9f1-4d52-9b7a-1283e7ca4935 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:16.875339 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-5efd74ce-d9f1-4d52-9b7a-1283e7ca4935 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:16.875893 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-5efd74ce-d9f1-4d52-9b7a-1283e7ca4935 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:16.892305 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.wsgi [None req-5efd74ce-d9f1-4d52-9b7a-1283e7ca4935 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] HTTP exception thrown: Instance c31d034b-2cf3-4518-8e50-8beda1897c20 could not be found. May 19 21:33:16.921294 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-5efd74ce-d9f1-4d52-9b7a-1283e7ca4935 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Request method failure captured: May 19 21:33:16.921294 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: request: GET /compute/v2.1/servers/c31d034b-2cf3-4518-8e50-8beda1897c20 HTTP/1.1 May 19 21:33:16.921294 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Accept: application/json May 19 21:33:16.921294 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Accept-Encoding: identity May 19 21:33:16.921294 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Connection: close May 19 21:33:16.921294 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Content-Length: 0 May 19 21:33:16.921294 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Content-Type: application/json May 19 21:33:16.921294 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Host: 10.222.0.65 May 19 21:33:16.921294 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Openstack-System-Scope: None May 19 21:33:16.921294 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: User-Agent: python-urllib3/1.26.9 May 19 21:33:16.921294 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Auth-Token: gAAAAABihrdXEJOW2cOZQF33buoea6NjNxsfNnlTA1djfAc-CeuulQDxKmA14WLSbxbABGHoSvrK7d85YCjLrqoBAQU50Oirdv_UWTJphe7z7OEhFOfUIgZv8U9LM_QboFx7XYvetpkZuCVK5i-wPhIK4EHG2QqFjTkrXEGbE3-3G4vm9vYZTls May 19 21:33:16.921294 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Domain-Id: None May 19 21:33:16.921294 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Domain-Name: None May 19 21:33:16.921294 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Identity-Status: Confirmed May 19 21:33:16.921294 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Is-Admin-Project: True May 19 21:33:16.921294 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Project-Domain-Id: default May 19 21:33:16.921294 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Project-Domain-Name: Default May 19 21:33:16.921294 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Project-Id: 6166dc89ce0545c1bbb8adb947034e79 May 19 21:33:16.921294 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Project-Name: tempest-DeleteServersTestJSON-1964480997 May 19 21:33:16.921294 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Role: reader,member May 19 21:33:16.921294 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Roles: reader,member May 19 21:33:16.922752 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/6166dc89ce0545c1bbb8adb947034e79"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/6166dc89ce0545c1bbb8adb947034e79"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_6166dc89ce0545c1bbb8adb947034e79"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/6166dc89ce0545c1bbb8adb947034e79"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}] May 19 21:33:16.922752 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Tenant: tempest-DeleteServersTestJSON-1964480997 May 19 21:33:16.922752 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Tenant-Id: 6166dc89ce0545c1bbb8adb947034e79 May 19 21:33:16.922752 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Tenant-Name: tempest-DeleteServersTestJSON-1964480997 May 19 21:33:16.922752 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-User: tempest-DeleteServersTestJSON-1964480997-project May 19 21:33:16.922752 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-User-Domain-Id: default May 19 21:33:16.922752 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-User-Domain-Name: Default May 19 21:33:16.922752 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-User-Id: bc570204a2bb4889889a67850dd1d9fe May 19 21:33:16.922752 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-User-Name: tempest-DeleteServersTestJSON-1964480997-project May 19 21:33:16.922752 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: method: > May 19 21:33:16.922752 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: exception: Instance c31d034b-2cf3-4518-8e50-8beda1897c20 could not be found. May 19 21:33:16.922752 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: action_args: {'id': 'c31d034b-2cf3-4518-8e50-8beda1897c20'} May 19 21:33:16.923500 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 21:33:16.923500 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:33:16.923500 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 21:33:16.923500 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 21:33:16.923500 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 21:33:16.923500 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 21:33:16.923500 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 21:33:16.923500 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 21:33:16.923500 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 21:33:16.923500 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 21:33:16.923500 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c31d034b-2cf3-4518-8e50-8beda1897c20 could not be found. May 19 21:33:16.923500 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:33:16.923500 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 21:33:16.923500 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:33:16.923500 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:33:16.923500 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 21:33:16.923500 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 21:33:16.923500 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 21:33:16.923500 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 21:33:16.923500 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 21:33:16.925013 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 21:33:16.925013 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 21:33:16.925013 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 21:33:16.925013 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 21:33:16.925013 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 21:33:16.925013 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 21:33:16.925013 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 21:33:16.925013 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c31d034b-2cf3-4518-8e50-8beda1897c20 could not be found. May 19 21:33:16.925013 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:33:16.925013 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 21:33:16.925013 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:33:16.925013 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:33:16.925013 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 21:33:16.925013 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 21:33:16.925013 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 21:33:16.925013 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 21:33:16.925013 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c31d034b-2cf3-4518-8e50-8beda1897c20 could not be found. May 19 21:33:16.925013 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:33:16.926490 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-5efd74ce-d9f1-4d52-9b7a-1283e7ca4935 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Returning 404 to user: Instance c31d034b-2cf3-4518-8e50-8beda1897c20 could not be found. {{(pid=124349) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 21:33:16.926490 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-5efd74ce-d9f1-4d52-9b7a-1283e7ca4935 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] 10.222.0.65 "GET /compute/v2.1/servers/c31d034b-2cf3-4518-8e50-8beda1897c20" status: 404 len: 111 microversion: 2.1 time: 0.064948 May 19 21:33:16.926490 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 73/154] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:33:16 2022] GET /compute/v2.1/servers/c31d034b-2cf3-4518-8e50-8beda1897c20 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 21:33:17.054124 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [req-72ab7643-9a04-4caa-a2f2-73fbb5eb7b4e req-c67a5fea-6fc4-4bb2-9fa2-878710a1711c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a392a14d-152c-467f-8031-a4bb8e36e5bb", "tag": "273956f8-6ada-4c24-9d33-e37b581a5bb1"}]} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:33:17.068719 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-72ab7643-9a04-4caa-a2f2-73fbb5eb7b4e req-c67a5fea-6fc4-4bb2-9fa2-878710a1711c service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:17.069159 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-72ab7643-9a04-4caa-a2f2-73fbb5eb7b4e req-c67a5fea-6fc4-4bb2-9fa2-878710a1711c service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:17.079534 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-ccfb7661-8141-4352-9c84-bd905a20f219 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:33:17.081033 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-ccfb7661-8141-4352-9c84-bd905a20f219 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] [instance: c31d034b-2cf3-4518-8e50-8beda1897c20] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:33:17.093930 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ccfb7661-8141-4352-9c84-bd905a20f219 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:17.095740 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ccfb7661-8141-4352-9c84-bd905a20f219 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:17.097918 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ccfb7661-8141-4352-9c84-bd905a20f219 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:17.098664 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ccfb7661-8141-4352-9c84-bd905a20f219 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:17.100389 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.compute.server_external_events [req-72ab7643-9a04-4caa-a2f2-73fbb5eb7b4e req-c67a5fea-6fc4-4bb2-9fa2-878710a1711c service nova] Creating event network-changed:273956f8-6ada-4c24-9d33-e37b581a5bb1 for instance a392a14d-152c-467f-8031-a4bb8e36e5bb on hv-cinder-83563 May 19 21:33:17.118490 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.wsgi [None req-ccfb7661-8141-4352-9c84-bd905a20f219 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] HTTP exception thrown: Instance c31d034b-2cf3-4518-8e50-8beda1897c20 could not be found. May 19 21:33:17.118747 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [req-72ab7643-9a04-4caa-a2f2-73fbb5eb7b4e req-c67a5fea-6fc4-4bb2-9fa2-878710a1711c service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067977 May 19 21:33:17.119507 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 82/155] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 21:33:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 21:33:17.131864 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-ccfb7661-8141-4352-9c84-bd905a20f219 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Request method failure captured: May 19 21:33:17.131864 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: request: GET /compute/v2.1/servers/c31d034b-2cf3-4518-8e50-8beda1897c20/os-volume_attachments HTTP/1.1 May 19 21:33:17.131864 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Accept: application/json May 19 21:33:17.131864 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Accept-Encoding: identity May 19 21:33:17.131864 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Connection: close May 19 21:33:17.131864 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Content-Length: 0 May 19 21:33:17.131864 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Content-Type: application/json May 19 21:33:17.131864 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Host: 10.222.0.65 May 19 21:33:17.131864 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Openstack-System-Scope: None May 19 21:33:17.131864 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: User-Agent: python-urllib3/1.26.9 May 19 21:33:17.131864 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Auth-Token: gAAAAABihrdXEJOW2cOZQF33buoea6NjNxsfNnlTA1djfAc-CeuulQDxKmA14WLSbxbABGHoSvrK7d85YCjLrqoBAQU50Oirdv_UWTJphe7z7OEhFOfUIgZv8U9LM_QboFx7XYvetpkZuCVK5i-wPhIK4EHG2QqFjTkrXEGbE3-3G4vm9vYZTls May 19 21:33:17.131864 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Domain-Id: None May 19 21:33:17.131864 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Domain-Name: None May 19 21:33:17.131864 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Identity-Status: Confirmed May 19 21:33:17.131864 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Is-Admin-Project: True May 19 21:33:17.131864 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Project-Domain-Id: default May 19 21:33:17.131864 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Project-Domain-Name: Default May 19 21:33:17.131864 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Project-Id: 6166dc89ce0545c1bbb8adb947034e79 May 19 21:33:17.131864 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Project-Name: tempest-DeleteServersTestJSON-1964480997 May 19 21:33:17.131864 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Role: reader,member May 19 21:33:17.131864 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Roles: reader,member May 19 21:33:17.133491 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/6166dc89ce0545c1bbb8adb947034e79"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/6166dc89ce0545c1bbb8adb947034e79"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_6166dc89ce0545c1bbb8adb947034e79"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/6166dc89ce0545c1bbb8adb947034e79"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}] May 19 21:33:17.133491 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Tenant: tempest-DeleteServersTestJSON-1964480997 May 19 21:33:17.133491 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Tenant-Id: 6166dc89ce0545c1bbb8adb947034e79 May 19 21:33:17.133491 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Tenant-Name: tempest-DeleteServersTestJSON-1964480997 May 19 21:33:17.133491 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-User: tempest-DeleteServersTestJSON-1964480997-project May 19 21:33:17.133491 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-User-Domain-Id: default May 19 21:33:17.133491 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-User-Domain-Name: Default May 19 21:33:17.133491 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-User-Id: bc570204a2bb4889889a67850dd1d9fe May 19 21:33:17.133491 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-User-Name: tempest-DeleteServersTestJSON-1964480997-project May 19 21:33:17.133491 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: method: > May 19 21:33:17.133491 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: exception: Instance c31d034b-2cf3-4518-8e50-8beda1897c20 could not be found. May 19 21:33:17.133491 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: action_args: {'server_id': 'c31d034b-2cf3-4518-8e50-8beda1897c20'} May 19 21:33:17.134231 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 21:33:17.134231 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:33:17.134231 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 21:33:17.134231 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 21:33:17.134231 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 21:33:17.134231 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 21:33:17.134231 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 21:33:17.134231 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 21:33:17.134231 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 21:33:17.134231 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 21:33:17.134231 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c31d034b-2cf3-4518-8e50-8beda1897c20 could not be found. May 19 21:33:17.134231 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:33:17.134231 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 21:33:17.134231 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:33:17.134231 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:33:17.134231 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 21:33:17.134231 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 21:33:17.134231 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 21:33:17.134231 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 21:33:17.134231 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 21:33:17.135303 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 21:33:17.135303 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 19 21:33:17.135303 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 21:33:17.135303 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 19 21:33:17.135303 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 21:33:17.135303 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index May 19 21:33:17.135303 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) May 19 21:33:17.135303 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 21:33:17.135303 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 21:33:17.135303 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c31d034b-2cf3-4518-8e50-8beda1897c20 could not be found. May 19 21:33:17.135303 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:33:17.135303 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 21:33:17.135303 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:33:17.135303 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:33:17.135303 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 21:33:17.135303 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 21:33:17.135303 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 21:33:17.135303 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 21:33:17.135303 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c31d034b-2cf3-4518-8e50-8beda1897c20 could not be found. May 19 21:33:17.135303 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:33:17.136323 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-ccfb7661-8141-4352-9c84-bd905a20f219 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Returning 404 to user: Instance c31d034b-2cf3-4518-8e50-8beda1897c20 could not be found. {{(pid=124349) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 21:33:17.136323 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-ccfb7661-8141-4352-9c84-bd905a20f219 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] 10.222.0.65 "GET /compute/v2.1/servers/c31d034b-2cf3-4518-8e50-8beda1897c20/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.060501 May 19 21:33:17.145661 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 74/156] 10.222.0.65 () {58 vars in 1301 bytes} [Thu May 19 21:33:17 2022] GET /compute/v2.1/servers/c31d034b-2cf3-4518-8e50-8beda1897c20/os-volume_attachments => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 21:33:17.599839 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-c895f635-aed0-4bae-a996-e4e0067e3f59 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:33:17.601283 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-c895f635-aed0-4bae-a996-e4e0067e3f59 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:33:17.610561 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c895f635-aed0-4bae-a996-e4e0067e3f59 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:17.612557 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c895f635-aed0-4bae-a996-e4e0067e3f59 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:17.614627 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c895f635-aed0-4bae-a996-e4e0067e3f59 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:17.620535 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c895f635-aed0-4bae-a996-e4e0067e3f59 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:18.014027 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-c895f635-aed0-4bae-a996-e4e0067e3f59 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1589968f375946a38e82ec484afc837f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c62c1f3c54f568abdac37360ab457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:33:18.026732 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-c895f635-aed0-4bae-a996-e4e0067e3f59 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "GET /compute/v2.1/servers/e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7" status: 200 len: 1523 microversion: 2.1 time: 0.432068 May 19 21:33:18.049385 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 83/157] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:33:17 2022] GET /compute/v2.1/servers/e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7 => generated 1523 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:33:18.448901 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-93a61a67-acf3-4098-ad31-771c241c781c tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:33:18.449716 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-93a61a67-acf3-4098-ad31-771c241c781c tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] [instance: c31d034b-2cf3-4518-8e50-8beda1897c20] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:33:18.456265 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_api:SELECT=88 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:33:18.458130 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-93a61a67-acf3-4098-ad31-771c241c781c tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:18.463491 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-93a61a67-acf3-4098-ad31-771c241c781c tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:18.464413 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-93a61a67-acf3-4098-ad31-771c241c781c tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:18.464859 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-93a61a67-acf3-4098-ad31-771c241c781c tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:18.493809 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.wsgi [None req-93a61a67-acf3-4098-ad31-771c241c781c tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] HTTP exception thrown: Instance c31d034b-2cf3-4518-8e50-8beda1897c20 could not be found. May 19 21:33:18.499104 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-93a61a67-acf3-4098-ad31-771c241c781c tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Request method failure captured: May 19 21:33:18.499104 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: request: DELETE /compute/v2.1/servers/c31d034b-2cf3-4518-8e50-8beda1897c20 HTTP/1.1 May 19 21:33:18.499104 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Accept: application/json May 19 21:33:18.499104 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Accept-Encoding: identity May 19 21:33:18.499104 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Connection: close May 19 21:33:18.499104 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Content-Length: 0 May 19 21:33:18.499104 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Content-Type: application/json May 19 21:33:18.499104 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Host: 10.222.0.65 May 19 21:33:18.499104 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Openstack-System-Scope: None May 19 21:33:18.499104 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: User-Agent: python-urllib3/1.26.9 May 19 21:33:18.499104 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Auth-Token: gAAAAABihrdXEJOW2cOZQF33buoea6NjNxsfNnlTA1djfAc-CeuulQDxKmA14WLSbxbABGHoSvrK7d85YCjLrqoBAQU50Oirdv_UWTJphe7z7OEhFOfUIgZv8U9LM_QboFx7XYvetpkZuCVK5i-wPhIK4EHG2QqFjTkrXEGbE3-3G4vm9vYZTls May 19 21:33:18.499104 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Domain-Id: None May 19 21:33:18.499104 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Domain-Name: None May 19 21:33:18.499104 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Identity-Status: Confirmed May 19 21:33:18.499104 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Is-Admin-Project: True May 19 21:33:18.499104 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Project-Domain-Id: default May 19 21:33:18.499104 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Project-Domain-Name: Default May 19 21:33:18.499104 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Project-Id: 6166dc89ce0545c1bbb8adb947034e79 May 19 21:33:18.499104 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Project-Name: tempest-DeleteServersTestJSON-1964480997 May 19 21:33:18.499104 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Role: reader,member May 19 21:33:18.499104 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Roles: reader,member May 19 21:33:18.500398 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/6166dc89ce0545c1bbb8adb947034e79"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/6166dc89ce0545c1bbb8adb947034e79"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_6166dc89ce0545c1bbb8adb947034e79"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/6166dc89ce0545c1bbb8adb947034e79"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}] May 19 21:33:18.500398 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Tenant: tempest-DeleteServersTestJSON-1964480997 May 19 21:33:18.500398 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Tenant-Id: 6166dc89ce0545c1bbb8adb947034e79 May 19 21:33:18.500398 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Tenant-Name: tempest-DeleteServersTestJSON-1964480997 May 19 21:33:18.500398 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-User: tempest-DeleteServersTestJSON-1964480997-project May 19 21:33:18.500398 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-User-Domain-Id: default May 19 21:33:18.500398 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-User-Domain-Name: Default May 19 21:33:18.500398 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-User-Id: bc570204a2bb4889889a67850dd1d9fe May 19 21:33:18.500398 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-User-Name: tempest-DeleteServersTestJSON-1964480997-project May 19 21:33:18.500398 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: method: > May 19 21:33:18.500398 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: exception: Instance c31d034b-2cf3-4518-8e50-8beda1897c20 could not be found. May 19 21:33:18.500398 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: action_args: {'id': 'c31d034b-2cf3-4518-8e50-8beda1897c20'} May 19 21:33:18.501160 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 21:33:18.501160 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:33:18.501160 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 21:33:18.501160 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 21:33:18.501160 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 21:33:18.501160 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 21:33:18.501160 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 21:33:18.501160 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 21:33:18.501160 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 21:33:18.501160 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 21:33:18.501160 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c31d034b-2cf3-4518-8e50-8beda1897c20 could not be found. May 19 21:33:18.501160 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:33:18.501160 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 21:33:18.501160 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:33:18.501160 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:33:18.501160 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 21:33:18.501160 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 21:33:18.501160 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 21:33:18.501160 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 21:33:18.501160 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 21:33:18.503194 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 21:33:18.503194 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 19 21:33:18.503194 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 21:33:18.503194 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 19 21:33:18.503194 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 21:33:18.503194 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 21:33:18.503194 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 21:33:18.503194 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 21:33:18.503194 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 21:33:18.503194 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c31d034b-2cf3-4518-8e50-8beda1897c20 could not be found. May 19 21:33:18.503194 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:33:18.503194 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 21:33:18.503194 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:33:18.503194 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:33:18.503194 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 21:33:18.503194 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 21:33:18.503194 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 21:33:18.503194 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 21:33:18.503194 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c31d034b-2cf3-4518-8e50-8beda1897c20 could not be found. May 19 21:33:18.503194 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:33:18.510782 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-93a61a67-acf3-4098-ad31-771c241c781c tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Returning 404 to user: Instance c31d034b-2cf3-4518-8e50-8beda1897c20 could not be found. {{(pid=124349) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 21:33:18.510782 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-93a61a67-acf3-4098-ad31-771c241c781c tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] 10.222.0.65 "DELETE /compute/v2.1/servers/c31d034b-2cf3-4518-8e50-8beda1897c20" status: 404 len: 111 microversion: 2.1 time: 0.066630 May 19 21:33:18.511875 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 75/158] 10.222.0.65 () {58 vars in 1238 bytes} [Thu May 19 21:33:18 2022] DELETE /compute/v2.1/servers/c31d034b-2cf3-4518-8e50-8beda1897c20 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 21:33:18.517560 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-6c26e04a-d41b-40f6-bec0-3d6ed44ec8b5 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:33:18.518679 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-6c26e04a-d41b-40f6-bec0-3d6ed44ec8b5 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] [instance: c31d034b-2cf3-4518-8e50-8beda1897c20] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:33:18.530973 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6c26e04a-d41b-40f6-bec0-3d6ed44ec8b5 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:18.531558 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6c26e04a-d41b-40f6-bec0-3d6ed44ec8b5 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:18.533792 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6c26e04a-d41b-40f6-bec0-3d6ed44ec8b5 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:18.534781 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6c26e04a-d41b-40f6-bec0-3d6ed44ec8b5 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:18.553115 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.wsgi [None req-6c26e04a-d41b-40f6-bec0-3d6ed44ec8b5 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] HTTP exception thrown: Instance c31d034b-2cf3-4518-8e50-8beda1897c20 could not be found. May 19 21:33:18.558680 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-6c26e04a-d41b-40f6-bec0-3d6ed44ec8b5 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Request method failure captured: May 19 21:33:18.558680 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: request: GET /compute/v2.1/servers/c31d034b-2cf3-4518-8e50-8beda1897c20 HTTP/1.1 May 19 21:33:18.558680 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Accept: application/json May 19 21:33:18.558680 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Accept-Encoding: identity May 19 21:33:18.558680 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Connection: close May 19 21:33:18.558680 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Content-Length: 0 May 19 21:33:18.558680 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Content-Type: application/json May 19 21:33:18.558680 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Host: 10.222.0.65 May 19 21:33:18.558680 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Openstack-System-Scope: None May 19 21:33:18.558680 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: User-Agent: python-urllib3/1.26.9 May 19 21:33:18.558680 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Auth-Token: gAAAAABihrdXEJOW2cOZQF33buoea6NjNxsfNnlTA1djfAc-CeuulQDxKmA14WLSbxbABGHoSvrK7d85YCjLrqoBAQU50Oirdv_UWTJphe7z7OEhFOfUIgZv8U9LM_QboFx7XYvetpkZuCVK5i-wPhIK4EHG2QqFjTkrXEGbE3-3G4vm9vYZTls May 19 21:33:18.558680 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Domain-Id: None May 19 21:33:18.558680 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Domain-Name: None May 19 21:33:18.558680 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Identity-Status: Confirmed May 19 21:33:18.558680 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Is-Admin-Project: True May 19 21:33:18.558680 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Project-Domain-Id: default May 19 21:33:18.558680 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Project-Domain-Name: Default May 19 21:33:18.558680 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Project-Id: 6166dc89ce0545c1bbb8adb947034e79 May 19 21:33:18.558680 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Project-Name: tempest-DeleteServersTestJSON-1964480997 May 19 21:33:18.558680 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Role: reader,member May 19 21:33:18.558680 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Roles: reader,member May 19 21:33:18.559861 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/6166dc89ce0545c1bbb8adb947034e79"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/6166dc89ce0545c1bbb8adb947034e79"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_6166dc89ce0545c1bbb8adb947034e79"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/6166dc89ce0545c1bbb8adb947034e79"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}] May 19 21:33:18.559861 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Tenant: tempest-DeleteServersTestJSON-1964480997 May 19 21:33:18.559861 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Tenant-Id: 6166dc89ce0545c1bbb8adb947034e79 May 19 21:33:18.559861 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Tenant-Name: tempest-DeleteServersTestJSON-1964480997 May 19 21:33:18.559861 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-User: tempest-DeleteServersTestJSON-1964480997-project May 19 21:33:18.559861 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-User-Domain-Id: default May 19 21:33:18.559861 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-User-Domain-Name: Default May 19 21:33:18.559861 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-User-Id: bc570204a2bb4889889a67850dd1d9fe May 19 21:33:18.559861 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-User-Name: tempest-DeleteServersTestJSON-1964480997-project May 19 21:33:18.559861 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: method: > May 19 21:33:18.559861 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: exception: Instance c31d034b-2cf3-4518-8e50-8beda1897c20 could not be found. May 19 21:33:18.559861 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: action_args: {'id': 'c31d034b-2cf3-4518-8e50-8beda1897c20'} May 19 21:33:18.560674 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 21:33:18.560674 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:33:18.560674 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 21:33:18.560674 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 21:33:18.560674 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 21:33:18.560674 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 21:33:18.560674 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 21:33:18.560674 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 21:33:18.560674 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 21:33:18.560674 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 21:33:18.560674 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c31d034b-2cf3-4518-8e50-8beda1897c20 could not be found. May 19 21:33:18.560674 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi May 19 21:33:18.560674 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 21:33:18.560674 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi May 19 21:33:18.560674 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:33:18.560674 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 21:33:18.560674 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 21:33:18.560674 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 21:33:18.560674 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 21:33:18.560674 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 21:33:18.561707 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 21:33:18.561707 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 21:33:18.561707 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 21:33:18.561707 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 21:33:18.561707 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 21:33:18.561707 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 21:33:18.561707 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 21:33:18.561707 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c31d034b-2cf3-4518-8e50-8beda1897c20 could not be found. May 19 21:33:18.561707 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi May 19 21:33:18.561707 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 21:33:18.561707 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi May 19 21:33:18.561707 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:33:18.561707 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 21:33:18.561707 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 21:33:18.561707 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 21:33:18.561707 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 21:33:18.561707 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c31d034b-2cf3-4518-8e50-8beda1897c20 could not be found. May 19 21:33:18.561707 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi May 19 21:33:18.565515 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-6c26e04a-d41b-40f6-bec0-3d6ed44ec8b5 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] Returning 404 to user: Instance c31d034b-2cf3-4518-8e50-8beda1897c20 could not be found. {{(pid=124350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 21:33:18.566739 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-6c26e04a-d41b-40f6-bec0-3d6ed44ec8b5 tempest-DeleteServersTestJSON-1964480997 tempest-DeleteServersTestJSON-1964480997-project] 10.222.0.65 "GET /compute/v2.1/servers/c31d034b-2cf3-4518-8e50-8beda1897c20" status: 404 len: 111 microversion: 2.1 time: 0.053726 May 19 21:33:18.571927 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 84/159] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:33:18 2022] GET /compute/v2.1/servers/c31d034b-2cf3-4518-8e50-8beda1897c20 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 21:33:19.060059 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-1f8390f1-80d3-45c0-8abb-cd20c787a3b7 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:33:19.060704 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-1f8390f1-80d3-45c0-8abb-cd20c787a3b7 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:33:19.068328 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1f8390f1-80d3-45c0-8abb-cd20c787a3b7 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:19.068779 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1f8390f1-80d3-45c0-8abb-cd20c787a3b7 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:19.069582 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1f8390f1-80d3-45c0-8abb-cd20c787a3b7 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:19.070011 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1f8390f1-80d3-45c0-8abb-cd20c787a3b7 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:19.249597 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-1f8390f1-80d3-45c0-8abb-cd20c787a3b7 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1589968f375946a38e82ec484afc837f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c62c1f3c54f568abdac37360ab457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:33:19.260437 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-1f8390f1-80d3-45c0-8abb-cd20c787a3b7 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "GET /compute/v2.1/servers/e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7" status: 200 len: 1523 microversion: 2.1 time: 0.207962 May 19 21:33:19.261299 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 76/160] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:33:19 2022] GET /compute/v2.1/servers/e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7 => generated 1523 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:33:20.281652 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-79e53bc2-97a4-417e-9b52-9eb5982ff800 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:33:20.284006 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-79e53bc2-97a4-417e-9b52-9eb5982ff800 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:33:20.296613 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-79e53bc2-97a4-417e-9b52-9eb5982ff800 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:20.297333 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-79e53bc2-97a4-417e-9b52-9eb5982ff800 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:20.298715 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-79e53bc2-97a4-417e-9b52-9eb5982ff800 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:20.299441 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-79e53bc2-97a4-417e-9b52-9eb5982ff800 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:20.305380 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:33:20.504517 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-79e53bc2-97a4-417e-9b52-9eb5982ff800 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1589968f375946a38e82ec484afc837f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c62c1f3c54f568abdac37360ab457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:33:20.513683 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-79e53bc2-97a4-417e-9b52-9eb5982ff800 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "GET /compute/v2.1/servers/e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7" status: 200 len: 1523 microversion: 2.1 time: 0.237245 May 19 21:33:20.514301 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 85/161] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:33:20 2022] GET /compute/v2.1/servers/e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7 => generated 1523 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 21:33:21.452036 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-1d2c41bc-61b9-4863-baa1-ad9d64b9d8ab tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1427862229", "imageRef": "a874457a-f8a8-46f6-bdcc-1fa632a0d3c0", "flavorRef": "452", "networks": [{"uuid": "dead0934-78cb-4aba-a85a-e1a39596f2e4"}]}} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:33:21.529677 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.network.neutron [None req-1d2c41bc-61b9-4863-baa1-ad9d64b9d8ab tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] validate_networks() for [('dead0934-78cb-4aba-a85a-e1a39596f2e4', None, None, None, None, None)] {{(pid=124349) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 19 21:33:21.541207 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-f0211128-0302-453d-a0d6-549a410438be tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:33:21.542121 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-f0211128-0302-453d-a0d6-549a410438be tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:33:21.554407 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f0211128-0302-453d-a0d6-549a410438be tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:21.555184 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f0211128-0302-453d-a0d6-549a410438be tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:21.556522 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f0211128-0302-453d-a0d6-549a410438be tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:21.557264 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f0211128-0302-453d-a0d6-549a410438be tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:22.025535 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-f0211128-0302-453d-a0d6-549a410438be tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1589968f375946a38e82ec484afc837f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c62c1f3c54f568abdac37360ab457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:33:22.046017 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-f0211128-0302-453d-a0d6-549a410438be tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "GET /compute/v2.1/servers/e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7" status: 200 len: 1523 microversion: 2.1 time: 0.513327 May 19 21:33:22.046932 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 86/162] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:33:21 2022] GET /compute/v2.1/servers/e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7 => generated 1523 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:33:22.154519 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.virt.hardware [None req-1d2c41bc-61b9-4863-baa1-ad9d64b9d8ab tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Flavor limits 0:0:0 {{(pid=124349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 21:33:22.155006 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.virt.hardware [None req-1d2c41bc-61b9-4863-baa1-ad9d64b9d8ab tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Image limits 0:0:0 {{(pid=124349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 21:33:22.155573 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.virt.hardware [None req-1d2c41bc-61b9-4863-baa1-ad9d64b9d8ab tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Flavor pref 0:0:0 {{(pid=124349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 21:33:22.156116 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.virt.hardware [None req-1d2c41bc-61b9-4863-baa1-ad9d64b9d8ab tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Image pref 0:0:0 {{(pid=124349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 21:33:22.156703 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.virt.hardware [None req-1d2c41bc-61b9-4863-baa1-ad9d64b9d8ab tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 21:33:22.169359 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1d2c41bc-61b9-4863-baa1-ad9d64b9d8ab tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:22.170106 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1d2c41bc-61b9-4863-baa1-ad9d64b9d8ab tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:22.171496 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1d2c41bc-61b9-4863-baa1-ad9d64b9d8ab tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:22.172182 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1d2c41bc-61b9-4863-baa1-ad9d64b9d8ab tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:22.204949 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.quota [None req-1d2c41bc-61b9-4863-baa1-ad9d64b9d8ab tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Getting quotas for project f9c4f4baaf8f4a258171bf97abdc8905. Resources: {'ram', 'cores', 'instances'} {{(pid=124349) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 21:33:22.210209 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.quota [None req-1d2c41bc-61b9-4863-baa1-ad9d64b9d8ab tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Getting quotas for user 47575a76d62b4a109fda03f4bf016fc6 and project f9c4f4baaf8f4a258171bf97abdc8905. Resources: {'ram', 'cores', 'instances'} {{(pid=124349) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 21:33:22.225802 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-1d2c41bc-61b9-4863-baa1-ad9d64b9d8ab tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Going to run 1 instances... {{(pid=124349) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 21:33:22.228261 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-1d2c41bc-61b9-4863-baa1-ad9d64b9d8ab tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] [instance: e8bc93c6-b778-4b19-b0e7-a069570e9b12] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a874457a-f8a8-46f6-bdcc-1fa632a0d3c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124349) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 21:33:22.282568 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-1d2c41bc-61b9-4863-baa1-ad9d64b9d8ab tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.836576 May 19 21:33:22.284017 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 77/163] 10.222.0.65 () {60 vars in 1146 bytes} [Thu May 19 21:33:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 839 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 21:33:22.300261 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-1438552e-e260-49dc-968f-6fe6401ee562 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:33:22.301501 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-1438552e-e260-49dc-968f-6fe6401ee562 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] [instance: e8bc93c6-b778-4b19-b0e7-a069570e9b12] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:33:22.407391 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-1438552e-e260-49dc-968f-6fe6401ee562 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47575a76d62b4a109fda03f4bf016fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c4f4baaf8f4a258171bf97abdc8905', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:33:22.422337 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-1438552e-e260-49dc-968f-6fe6401ee562 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] 10.222.0.65 "GET /compute/v2.1/servers/e8bc93c6-b778-4b19-b0e7-a069570e9b12" status: 200 len: 1214 microversion: 2.1 time: 0.130001 May 19 21:33:22.423245 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 87/164] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:33:22 2022] GET /compute/v2.1/servers/e8bc93c6-b778-4b19-b0e7-a069570e9b12 => generated 1214 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:33:23.076183 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-c0ef9ecd-6ad3-43d7-b411-ebc67d0a3682 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:33:23.077283 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-c0ef9ecd-6ad3-43d7-b411-ebc67d0a3682 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:33:23.086073 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c0ef9ecd-6ad3-43d7-b411-ebc67d0a3682 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:23.086834 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c0ef9ecd-6ad3-43d7-b411-ebc67d0a3682 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:23.087862 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c0ef9ecd-6ad3-43d7-b411-ebc67d0a3682 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:23.088738 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c0ef9ecd-6ad3-43d7-b411-ebc67d0a3682 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:23.288427 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-c0ef9ecd-6ad3-43d7-b411-ebc67d0a3682 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1589968f375946a38e82ec484afc837f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c62c1f3c54f568abdac37360ab457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:33:23.300083 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-c0ef9ecd-6ad3-43d7-b411-ebc67d0a3682 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "GET /compute/v2.1/servers/e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7" status: 200 len: 1523 microversion: 2.1 time: 0.229201 May 19 21:33:23.300795 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 78/165] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:33:23 2022] GET /compute/v2.1/servers/e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7 => generated 1523 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:33:23.441640 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-5f59f8e4-0df3-4261-add4-cb467a026663 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:33:23.442325 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-5f59f8e4-0df3-4261-add4-cb467a026663 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] [instance: e8bc93c6-b778-4b19-b0e7-a069570e9b12] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:33:23.450798 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5f59f8e4-0df3-4261-add4-cb467a026663 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:23.451345 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5f59f8e4-0df3-4261-add4-cb467a026663 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:23.452128 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5f59f8e4-0df3-4261-add4-cb467a026663 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:23.452556 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5f59f8e4-0df3-4261-add4-cb467a026663 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:23.545512 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-5f59f8e4-0df3-4261-add4-cb467a026663 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47575a76d62b4a109fda03f4bf016fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c4f4baaf8f4a258171bf97abdc8905', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:33:23.559293 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-5f59f8e4-0df3-4261-add4-cb467a026663 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] 10.222.0.65 "GET /compute/v2.1/servers/e8bc93c6-b778-4b19-b0e7-a069570e9b12" status: 200 len: 1266 microversion: 2.1 time: 0.121954 May 19 21:33:23.561316 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 88/166] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:33:23 2022] GET /compute/v2.1/servers/e8bc93c6-b778-4b19-b0e7-a069570e9b12 => generated 1266 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:33:24.320300 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-f1032d21-29e4-4770-951f-97977ef7aba5 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:33:24.321335 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-f1032d21-29e4-4770-951f-97977ef7aba5 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:33:24.331857 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f1032d21-29e4-4770-951f-97977ef7aba5 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:24.332983 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f1032d21-29e4-4770-951f-97977ef7aba5 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:24.335127 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f1032d21-29e4-4770-951f-97977ef7aba5 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:24.335918 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f1032d21-29e4-4770-951f-97977ef7aba5 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:24.537973 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-f1032d21-29e4-4770-951f-97977ef7aba5 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1589968f375946a38e82ec484afc837f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c62c1f3c54f568abdac37360ab457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:33:24.552113 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-f1032d21-29e4-4770-951f-97977ef7aba5 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "GET /compute/v2.1/servers/e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7" status: 200 len: 1523 microversion: 2.1 time: 0.237742 May 19 21:33:24.552751 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 79/167] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:33:24 2022] GET /compute/v2.1/servers/e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7 => generated 1523 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:33:24.582766 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-d4a80c13-16a2-4ac2-ab09-9f3094674f8f tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:33:24.583864 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-d4a80c13-16a2-4ac2-ab09-9f3094674f8f tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] [instance: e8bc93c6-b778-4b19-b0e7-a069570e9b12] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:33:24.591929 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d4a80c13-16a2-4ac2-ab09-9f3094674f8f tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:24.592376 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d4a80c13-16a2-4ac2-ab09-9f3094674f8f tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:24.593201 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d4a80c13-16a2-4ac2-ab09-9f3094674f8f tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:24.593661 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d4a80c13-16a2-4ac2-ab09-9f3094674f8f tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:24.735579 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-d4a80c13-16a2-4ac2-ab09-9f3094674f8f tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47575a76d62b4a109fda03f4bf016fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c4f4baaf8f4a258171bf97abdc8905', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:33:24.756338 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-d4a80c13-16a2-4ac2-ab09-9f3094674f8f tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] 10.222.0.65 "GET /compute/v2.1/servers/e8bc93c6-b778-4b19-b0e7-a069570e9b12" status: 200 len: 1272 microversion: 2.1 time: 0.174703 May 19 21:33:24.756338 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 89/168] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:33:24 2022] GET /compute/v2.1/servers/e8bc93c6-b778-4b19-b0e7-a069570e9b12 => generated 1272 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:33:25.572002 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-3a227ad3-99e8-44a5-8c4b-803e8bbcf0b8 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:33:25.573360 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-3a227ad3-99e8-44a5-8c4b-803e8bbcf0b8 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:33:25.582386 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-3a227ad3-99e8-44a5-8c4b-803e8bbcf0b8 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:25.583074 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-3a227ad3-99e8-44a5-8c4b-803e8bbcf0b8 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:25.584578 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-3a227ad3-99e8-44a5-8c4b-803e8bbcf0b8 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:25.585627 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-3a227ad3-99e8-44a5-8c4b-803e8bbcf0b8 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:25.781899 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-328ac407-b874-4fad-8c9b-ead23224c221 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:33:25.784452 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-328ac407-b874-4fad-8c9b-ead23224c221 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] [instance: e8bc93c6-b778-4b19-b0e7-a069570e9b12] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:33:25.796445 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-328ac407-b874-4fad-8c9b-ead23224c221 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:25.798021 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-328ac407-b874-4fad-8c9b-ead23224c221 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:25.811656 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-328ac407-b874-4fad-8c9b-ead23224c221 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:25.813102 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-328ac407-b874-4fad-8c9b-ead23224c221 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:25.816184 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-3a227ad3-99e8-44a5-8c4b-803e8bbcf0b8 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1589968f375946a38e82ec484afc837f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c62c1f3c54f568abdac37360ab457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:33:25.829676 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-3a227ad3-99e8-44a5-8c4b-803e8bbcf0b8 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "GET /compute/v2.1/servers/e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7" status: 200 len: 1523 microversion: 2.1 time: 0.262846 May 19 21:33:25.831272 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 80/169] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:33:25 2022] GET /compute/v2.1/servers/e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7 => generated 1523 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 21:33:26.096717 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-328ac407-b874-4fad-8c9b-ead23224c221 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47575a76d62b4a109fda03f4bf016fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c4f4baaf8f4a258171bf97abdc8905', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:33:26.113569 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-328ac407-b874-4fad-8c9b-ead23224c221 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] 10.222.0.65 "GET /compute/v2.1/servers/e8bc93c6-b778-4b19-b0e7-a069570e9b12" status: 200 len: 1314 microversion: 2.1 time: 0.337794 May 19 21:33:26.115340 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 90/170] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:33:25 2022] GET /compute/v2.1/servers/e8bc93c6-b778-4b19-b0e7-a069570e9b12 => generated 1314 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:33:26.336884 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [req-ba1f5f7a-6d65-4344-9f7b-6cca4709a9bc req-80c5d1f6-f3d0-4bf1-ae34-f8e2a2d72ec7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8bc93c6-b778-4b19-b0e7-a069570e9b12", "tag": "458b882d-119e-4370-9bf2-e32c9066475d"}]} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:33:26.365786 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-ba1f5f7a-6d65-4344-9f7b-6cca4709a9bc req-80c5d1f6-f3d0-4bf1-ae34-f8e2a2d72ec7 service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:26.366277 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-ba1f5f7a-6d65-4344-9f7b-6cca4709a9bc req-80c5d1f6-f3d0-4bf1-ae34-f8e2a2d72ec7 service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:26.391582 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.compute.server_external_events [req-ba1f5f7a-6d65-4344-9f7b-6cca4709a9bc req-80c5d1f6-f3d0-4bf1-ae34-f8e2a2d72ec7 service nova] Creating event network-changed:458b882d-119e-4370-9bf2-e32c9066475d for instance e8bc93c6-b778-4b19-b0e7-a069570e9b12 on hv-cinder-83563 May 19 21:33:26.401574 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [req-ba1f5f7a-6d65-4344-9f7b-6cca4709a9bc req-80c5d1f6-f3d0-4bf1-ae34-f8e2a2d72ec7 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074084 May 19 21:33:26.402761 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 81/171] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 21:33:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 21:33:26.856261 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-7946fb21-d610-42ef-8731-1bb8d09af20e tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:33:26.858093 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-7946fb21-d610-42ef-8731-1bb8d09af20e tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:33:26.866878 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7946fb21-d610-42ef-8731-1bb8d09af20e tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:26.868187 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7946fb21-d610-42ef-8731-1bb8d09af20e tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:26.869337 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7946fb21-d610-42ef-8731-1bb8d09af20e tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:26.869772 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7946fb21-d610-42ef-8731-1bb8d09af20e tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:27.101222 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-7946fb21-d610-42ef-8731-1bb8d09af20e tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1589968f375946a38e82ec484afc837f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c62c1f3c54f568abdac37360ab457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:33:27.110144 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-7946fb21-d610-42ef-8731-1bb8d09af20e tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "GET /compute/v2.1/servers/e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7" status: 200 len: 1523 microversion: 2.1 time: 0.257630 May 19 21:33:27.111420 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 91/172] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:33:26 2022] GET /compute/v2.1/servers/e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7 => generated 1523 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:33:27.136602 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-2ed16dc1-28de-4e63-8cfb-1d2396c8c09e tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:33:27.137316 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-2ed16dc1-28de-4e63-8cfb-1d2396c8c09e tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] [instance: e8bc93c6-b778-4b19-b0e7-a069570e9b12] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:33:27.145183 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-2ed16dc1-28de-4e63-8cfb-1d2396c8c09e tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:27.145677 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-2ed16dc1-28de-4e63-8cfb-1d2396c8c09e tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:27.146547 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-2ed16dc1-28de-4e63-8cfb-1d2396c8c09e tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:27.147048 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-2ed16dc1-28de-4e63-8cfb-1d2396c8c09e tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:27.305209 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-2ed16dc1-28de-4e63-8cfb-1d2396c8c09e tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47575a76d62b4a109fda03f4bf016fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c4f4baaf8f4a258171bf97abdc8905', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:33:27.313901 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-2ed16dc1-28de-4e63-8cfb-1d2396c8c09e tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] 10.222.0.65 "GET /compute/v2.1/servers/e8bc93c6-b778-4b19-b0e7-a069570e9b12" status: 200 len: 1314 microversion: 2.1 time: 0.181973 May 19 21:33:27.315013 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 82/173] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:33:27 2022] GET /compute/v2.1/servers/e8bc93c6-b778-4b19-b0e7-a069570e9b12 => generated 1314 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:33:28.130073 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-441cb41d-fbf6-4126-ad7f-4688cfc85a32 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:33:28.130778 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-441cb41d-fbf6-4126-ad7f-4688cfc85a32 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:33:28.139550 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-441cb41d-fbf6-4126-ad7f-4688cfc85a32 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:28.139984 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-441cb41d-fbf6-4126-ad7f-4688cfc85a32 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:28.140775 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-441cb41d-fbf6-4126-ad7f-4688cfc85a32 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:28.141211 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-441cb41d-fbf6-4126-ad7f-4688cfc85a32 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:28.330650 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-441cb41d-fbf6-4126-ad7f-4688cfc85a32 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1589968f375946a38e82ec484afc837f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c62c1f3c54f568abdac37360ab457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:33:28.333967 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-17b8ae60-9dc8-40b9-875b-006efc9cc6d3 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:33:28.335547 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-17b8ae60-9dc8-40b9-875b-006efc9cc6d3 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] [instance: e8bc93c6-b778-4b19-b0e7-a069570e9b12] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:33:28.340897 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-441cb41d-fbf6-4126-ad7f-4688cfc85a32 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "GET /compute/v2.1/servers/e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7" status: 200 len: 1523 microversion: 2.1 time: 0.215744 May 19 21:33:28.341858 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 92/174] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:33:28 2022] GET /compute/v2.1/servers/e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7 => generated 1523 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:33:28.346138 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-17b8ae60-9dc8-40b9-875b-006efc9cc6d3 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:28.346921 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-17b8ae60-9dc8-40b9-875b-006efc9cc6d3 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:28.347856 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-17b8ae60-9dc8-40b9-875b-006efc9cc6d3 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:28.348645 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-17b8ae60-9dc8-40b9-875b-006efc9cc6d3 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:28.504894 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-17b8ae60-9dc8-40b9-875b-006efc9cc6d3 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47575a76d62b4a109fda03f4bf016fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c4f4baaf8f4a258171bf97abdc8905', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:33:28.512924 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-17b8ae60-9dc8-40b9-875b-006efc9cc6d3 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] 10.222.0.65 "GET /compute/v2.1/servers/e8bc93c6-b778-4b19-b0e7-a069570e9b12" status: 200 len: 1314 microversion: 2.1 time: 0.184269 May 19 21:33:28.513521 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 83/175] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:33:28 2022] GET /compute/v2.1/servers/e8bc93c6-b778-4b19-b0e7-a069570e9b12 => generated 1314 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:33:29.360417 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-543500ba-ddf0-4420-a37b-ad02f70b70c9 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:33:29.361503 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-543500ba-ddf0-4420-a37b-ad02f70b70c9 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:33:29.368824 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-543500ba-ddf0-4420-a37b-ad02f70b70c9 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:29.369405 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-543500ba-ddf0-4420-a37b-ad02f70b70c9 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:29.370405 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-543500ba-ddf0-4420-a37b-ad02f70b70c9 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:29.370944 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-543500ba-ddf0-4420-a37b-ad02f70b70c9 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:29.536538 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-543500ba-ddf0-4420-a37b-ad02f70b70c9 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1589968f375946a38e82ec484afc837f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c62c1f3c54f568abdac37360ab457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:33:29.538399 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-0741777b-827f-4661-ac6d-a9f89c8221d3 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:33:29.539161 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-0741777b-827f-4661-ac6d-a9f89c8221d3 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] [instance: e8bc93c6-b778-4b19-b0e7-a069570e9b12] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:33:29.546410 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-543500ba-ddf0-4420-a37b-ad02f70b70c9 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "GET /compute/v2.1/servers/e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7" status: 200 len: 1523 microversion: 2.1 time: 0.190163 May 19 21:33:29.546869 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-0741777b-827f-4661-ac6d-a9f89c8221d3 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:29.547030 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 93/176] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:33:29 2022] GET /compute/v2.1/servers/e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7 => generated 1523 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:33:29.547878 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-0741777b-827f-4661-ac6d-a9f89c8221d3 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:29.549134 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-0741777b-827f-4661-ac6d-a9f89c8221d3 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:29.549691 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-0741777b-827f-4661-ac6d-a9f89c8221d3 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:29.729690 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-0741777b-827f-4661-ac6d-a9f89c8221d3 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47575a76d62b4a109fda03f4bf016fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c4f4baaf8f4a258171bf97abdc8905', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:33:29.738163 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-0741777b-827f-4661-ac6d-a9f89c8221d3 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] 10.222.0.65 "GET /compute/v2.1/servers/e8bc93c6-b778-4b19-b0e7-a069570e9b12" status: 200 len: 1314 microversion: 2.1 time: 0.204398 May 19 21:33:29.738906 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 84/177] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:33:29 2022] GET /compute/v2.1/servers/e8bc93c6-b778-4b19-b0e7-a069570e9b12 => generated 1314 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:33:30.568428 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-4998f603-0d56-429d-abf5-1b8a69ecf407 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:33:30.569368 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-4998f603-0d56-429d-abf5-1b8a69ecf407 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:33:30.580510 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4998f603-0d56-429d-abf5-1b8a69ecf407 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:30.581218 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4998f603-0d56-429d-abf5-1b8a69ecf407 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:30.582479 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4998f603-0d56-429d-abf5-1b8a69ecf407 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:30.583177 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4998f603-0d56-429d-abf5-1b8a69ecf407 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:30.741914 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-4998f603-0d56-429d-abf5-1b8a69ecf407 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1589968f375946a38e82ec484afc837f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c62c1f3c54f568abdac37360ab457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:33:30.752011 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-4998f603-0d56-429d-abf5-1b8a69ecf407 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "GET /compute/v2.1/servers/e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7" status: 200 len: 1523 microversion: 2.1 time: 0.191192 May 19 21:33:30.752840 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 94/178] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:33:30 2022] GET /compute/v2.1/servers/e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7 => generated 1523 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:33:30.756354 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-2322c80a-32f5-4524-afb9-580746723a02 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:33:30.757171 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-2322c80a-32f5-4524-afb9-580746723a02 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] [instance: e8bc93c6-b778-4b19-b0e7-a069570e9b12] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:33:30.763716 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-2322c80a-32f5-4524-afb9-580746723a02 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:30.764156 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-2322c80a-32f5-4524-afb9-580746723a02 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:30.764928 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-2322c80a-32f5-4524-afb9-580746723a02 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:30.765384 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-2322c80a-32f5-4524-afb9-580746723a02 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:30.907214 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-2322c80a-32f5-4524-afb9-580746723a02 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47575a76d62b4a109fda03f4bf016fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c4f4baaf8f4a258171bf97abdc8905', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:33:30.909668 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_cell1:SELECT=100 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:33:30.916592 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-2322c80a-32f5-4524-afb9-580746723a02 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] 10.222.0.65 "GET /compute/v2.1/servers/e8bc93c6-b778-4b19-b0e7-a069570e9b12" status: 200 len: 1314 microversion: 2.1 time: 0.164518 May 19 21:33:30.917157 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 85/179] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:33:30 2022] GET /compute/v2.1/servers/e8bc93c6-b778-4b19-b0e7-a069570e9b12 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 21:33:31.770120 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-48b1a991-e57b-4076-8e20-e831e7f8e9f0 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:33:31.770859 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-48b1a991-e57b-4076-8e20-e831e7f8e9f0 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:33:31.778197 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-48b1a991-e57b-4076-8e20-e831e7f8e9f0 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:31.778747 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-48b1a991-e57b-4076-8e20-e831e7f8e9f0 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:31.779528 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-48b1a991-e57b-4076-8e20-e831e7f8e9f0 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:31.779956 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-48b1a991-e57b-4076-8e20-e831e7f8e9f0 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:31.922340 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-48b1a991-e57b-4076-8e20-e831e7f8e9f0 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1589968f375946a38e82ec484afc837f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c62c1f3c54f568abdac37360ab457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:33:31.930703 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-48b1a991-e57b-4076-8e20-e831e7f8e9f0 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "GET /compute/v2.1/servers/e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7" status: 200 len: 1523 microversion: 2.1 time: 0.164944 May 19 21:33:31.931299 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 95/180] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:33:31 2022] GET /compute/v2.1/servers/e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7 => generated 1523 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:33:31.934015 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-6a6fabbd-dfd5-4a50-8a6f-f7c0b5ddfe1a tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:33:31.934829 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-6a6fabbd-dfd5-4a50-8a6f-f7c0b5ddfe1a tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] [instance: e8bc93c6-b778-4b19-b0e7-a069570e9b12] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:33:31.941950 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-6a6fabbd-dfd5-4a50-8a6f-f7c0b5ddfe1a tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:31.942427 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-6a6fabbd-dfd5-4a50-8a6f-f7c0b5ddfe1a tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:31.943202 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-6a6fabbd-dfd5-4a50-8a6f-f7c0b5ddfe1a tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:31.943623 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-6a6fabbd-dfd5-4a50-8a6f-f7c0b5ddfe1a tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:32.095641 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-6a6fabbd-dfd5-4a50-8a6f-f7c0b5ddfe1a tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47575a76d62b4a109fda03f4bf016fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c4f4baaf8f4a258171bf97abdc8905', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:33:32.105197 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-6a6fabbd-dfd5-4a50-8a6f-f7c0b5ddfe1a tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] 10.222.0.65 "GET /compute/v2.1/servers/e8bc93c6-b778-4b19-b0e7-a069570e9b12" status: 200 len: 1314 microversion: 2.1 time: 0.175488 May 19 21:33:32.106030 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 86/181] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:33:31 2022] GET /compute/v2.1/servers/e8bc93c6-b778-4b19-b0e7-a069570e9b12 => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:33:32.948677 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-4accfd19-fc6e-4df8-8228-fe989612ddb5 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:33:32.949347 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-4accfd19-fc6e-4df8-8228-fe989612ddb5 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:33:32.951315 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell0:SELECT=2 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:33:32.958508 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4accfd19-fc6e-4df8-8228-fe989612ddb5 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:32.958951 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4accfd19-fc6e-4df8-8228-fe989612ddb5 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:32.959770 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4accfd19-fc6e-4df8-8228-fe989612ddb5 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:32.960224 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4accfd19-fc6e-4df8-8228-fe989612ddb5 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:33.117646 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-4accfd19-fc6e-4df8-8228-fe989612ddb5 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1589968f375946a38e82ec484afc837f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c62c1f3c54f568abdac37360ab457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:33:33.126633 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-1fa4cd2f-be07-4d61-9438-07205bc23bcb tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:33:33.127622 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-1fa4cd2f-be07-4d61-9438-07205bc23bcb tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] [instance: e8bc93c6-b778-4b19-b0e7-a069570e9b12] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:33:33.131365 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_cell0:SELECT=2 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:33:33.132448 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_cell0:SELECT=6 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:33:33.132625 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-4accfd19-fc6e-4df8-8228-fe989612ddb5 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "GET /compute/v2.1/servers/e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7" status: 200 len: 1523 microversion: 2.1 time: 0.187684 May 19 21:33:33.134164 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 96/182] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:33:32 2022] GET /compute/v2.1/servers/e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7 => generated 1523 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:33:33.141078 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1fa4cd2f-be07-4d61-9438-07205bc23bcb tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:33.141594 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1fa4cd2f-be07-4d61-9438-07205bc23bcb tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:33.143227 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1fa4cd2f-be07-4d61-9438-07205bc23bcb tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:33.143227 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1fa4cd2f-be07-4d61-9438-07205bc23bcb tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:33.304858 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-1fa4cd2f-be07-4d61-9438-07205bc23bcb tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47575a76d62b4a109fda03f4bf016fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c4f4baaf8f4a258171bf97abdc8905', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:33:33.314927 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-1fa4cd2f-be07-4d61-9438-07205bc23bcb tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] 10.222.0.65 "GET /compute/v2.1/servers/e8bc93c6-b778-4b19-b0e7-a069570e9b12" status: 200 len: 1314 microversion: 2.1 time: 0.194468 May 19 21:33:33.315553 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 87/183] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:33:33 2022] GET /compute/v2.1/servers/e8bc93c6-b778-4b19-b0e7-a069570e9b12 => generated 1314 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:33:34.157238 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-a62b270f-390a-4e92-a9ce-787f88149a4a tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:33:34.159046 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-a62b270f-390a-4e92-a9ce-787f88149a4a tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:33:34.170428 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a62b270f-390a-4e92-a9ce-787f88149a4a tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:34.170853 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a62b270f-390a-4e92-a9ce-787f88149a4a tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:34.171632 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a62b270f-390a-4e92-a9ce-787f88149a4a tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:34.172061 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a62b270f-390a-4e92-a9ce-787f88149a4a tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:34.334805 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-c552bf04-d5ea-40d5-8fd4-a0082fabca2c tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:33:34.335814 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-c552bf04-d5ea-40d5-8fd4-a0082fabca2c tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] [instance: e8bc93c6-b778-4b19-b0e7-a069570e9b12] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:33:34.344854 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c552bf04-d5ea-40d5-8fd4-a0082fabca2c tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:34.346376 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c552bf04-d5ea-40d5-8fd4-a0082fabca2c tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:34.346852 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-a62b270f-390a-4e92-a9ce-787f88149a4a tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1589968f375946a38e82ec484afc837f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c62c1f3c54f568abdac37360ab457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:33:34.347701 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c552bf04-d5ea-40d5-8fd4-a0082fabca2c tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:34.348368 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c552bf04-d5ea-40d5-8fd4-a0082fabca2c tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:34.359192 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-a62b270f-390a-4e92-a9ce-787f88149a4a tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "GET /compute/v2.1/servers/e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7" status: 200 len: 1523 microversion: 2.1 time: 0.209356 May 19 21:33:34.359899 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 97/184] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:33:34 2022] GET /compute/v2.1/servers/e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7 => generated 1523 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:33:34.553054 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-c552bf04-d5ea-40d5-8fd4-a0082fabca2c tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47575a76d62b4a109fda03f4bf016fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c4f4baaf8f4a258171bf97abdc8905', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:33:34.561255 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-c552bf04-d5ea-40d5-8fd4-a0082fabca2c tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] 10.222.0.65 "GET /compute/v2.1/servers/e8bc93c6-b778-4b19-b0e7-a069570e9b12" status: 200 len: 1314 microversion: 2.1 time: 0.232043 May 19 21:33:34.561821 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 88/185] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:33:34 2022] GET /compute/v2.1/servers/e8bc93c6-b778-4b19-b0e7-a069570e9b12 => generated 1314 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 21:33:35.385665 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-2e0972c3-ce55-4466-bb39-48750e4f45f0 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:33:35.386575 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-2e0972c3-ce55-4466-bb39-48750e4f45f0 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:33:35.399083 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2e0972c3-ce55-4466-bb39-48750e4f45f0 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:35.400128 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2e0972c3-ce55-4466-bb39-48750e4f45f0 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:35.401366 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2e0972c3-ce55-4466-bb39-48750e4f45f0 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:35.402024 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2e0972c3-ce55-4466-bb39-48750e4f45f0 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:35.584308 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-427058e4-de3e-4cb7-91fc-53f9867b9f05 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:33:35.586708 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-427058e4-de3e-4cb7-91fc-53f9867b9f05 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] [instance: e8bc93c6-b778-4b19-b0e7-a069570e9b12] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:33:35.598818 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-2e0972c3-ce55-4466-bb39-48750e4f45f0 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1589968f375946a38e82ec484afc837f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c62c1f3c54f568abdac37360ab457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:33:35.600311 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-427058e4-de3e-4cb7-91fc-53f9867b9f05 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:35.601469 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-427058e4-de3e-4cb7-91fc-53f9867b9f05 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:35.602851 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-427058e4-de3e-4cb7-91fc-53f9867b9f05 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:35.604351 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-427058e4-de3e-4cb7-91fc-53f9867b9f05 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:35.613390 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-2e0972c3-ce55-4466-bb39-48750e4f45f0 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "GET /compute/v2.1/servers/e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7" status: 200 len: 1523 microversion: 2.1 time: 0.231876 May 19 21:33:35.615740 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 98/186] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:33:35 2022] GET /compute/v2.1/servers/e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7 => generated 1523 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:33:35.812980 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-427058e4-de3e-4cb7-91fc-53f9867b9f05 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47575a76d62b4a109fda03f4bf016fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c4f4baaf8f4a258171bf97abdc8905', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:33:35.821605 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-427058e4-de3e-4cb7-91fc-53f9867b9f05 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] 10.222.0.65 "GET /compute/v2.1/servers/e8bc93c6-b778-4b19-b0e7-a069570e9b12" status: 200 len: 1314 microversion: 2.1 time: 0.244674 May 19 21:33:35.822308 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 89/187] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:33:35 2022] GET /compute/v2.1/servers/e8bc93c6-b778-4b19-b0e7-a069570e9b12 => generated 1314 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:33:36.633652 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-4d44a339-6848-40bf-b4b6-e72b7b671e99 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:33:36.635194 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-4d44a339-6848-40bf-b4b6-e72b7b671e99 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:33:36.646327 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4d44a339-6848-40bf-b4b6-e72b7b671e99 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:36.647019 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4d44a339-6848-40bf-b4b6-e72b7b671e99 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:36.649347 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4d44a339-6848-40bf-b4b6-e72b7b671e99 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:36.651730 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4d44a339-6848-40bf-b4b6-e72b7b671e99 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:36.851932 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-011d5798-315c-4178-ae70-40f6dafe2290 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:33:36.854987 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-011d5798-315c-4178-ae70-40f6dafe2290 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] [instance: e8bc93c6-b778-4b19-b0e7-a069570e9b12] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:33:36.868512 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-011d5798-315c-4178-ae70-40f6dafe2290 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:36.870493 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-011d5798-315c-4178-ae70-40f6dafe2290 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:36.872186 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-011d5798-315c-4178-ae70-40f6dafe2290 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:36.873156 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-011d5798-315c-4178-ae70-40f6dafe2290 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:37.060481 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-4d44a339-6848-40bf-b4b6-e72b7b671e99 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1589968f375946a38e82ec484afc837f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c62c1f3c54f568abdac37360ab457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:33:37.073364 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-4d44a339-6848-40bf-b4b6-e72b7b671e99 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "GET /compute/v2.1/servers/e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7" status: 200 len: 1523 microversion: 2.1 time: 0.444327 May 19 21:33:37.080397 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 99/188] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:33:36 2022] GET /compute/v2.1/servers/e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7 => generated 1523 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 21:33:37.216538 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-011d5798-315c-4178-ae70-40f6dafe2290 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47575a76d62b4a109fda03f4bf016fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c4f4baaf8f4a258171bf97abdc8905', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:33:37.244320 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-011d5798-315c-4178-ae70-40f6dafe2290 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] 10.222.0.65 "GET /compute/v2.1/servers/e8bc93c6-b778-4b19-b0e7-a069570e9b12" status: 200 len: 1314 microversion: 2.1 time: 0.400122 May 19 21:33:37.245813 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 90/189] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:33:36 2022] GET /compute/v2.1/servers/e8bc93c6-b778-4b19-b0e7-a069570e9b12 => generated 1314 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:33:38.105424 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-a5da03b4-5516-49ed-8740-94c26778c89d tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:33:38.106452 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-a5da03b4-5516-49ed-8740-94c26778c89d tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:33:38.115996 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a5da03b4-5516-49ed-8740-94c26778c89d tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:38.116527 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a5da03b4-5516-49ed-8740-94c26778c89d tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:38.117448 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a5da03b4-5516-49ed-8740-94c26778c89d tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:38.117966 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a5da03b4-5516-49ed-8740-94c26778c89d tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:38.264391 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-274d852c-cbc2-4260-bc1a-1c7ef8f95c15 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:33:38.265506 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-274d852c-cbc2-4260-bc1a-1c7ef8f95c15 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] [instance: e8bc93c6-b778-4b19-b0e7-a069570e9b12] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:33:38.277835 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-274d852c-cbc2-4260-bc1a-1c7ef8f95c15 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:38.278313 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-274d852c-cbc2-4260-bc1a-1c7ef8f95c15 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:38.279343 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-274d852c-cbc2-4260-bc1a-1c7ef8f95c15 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:38.279827 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-274d852c-cbc2-4260-bc1a-1c7ef8f95c15 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:38.377814 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-a5da03b4-5516-49ed-8740-94c26778c89d tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1589968f375946a38e82ec484afc837f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c62c1f3c54f568abdac37360ab457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:33:38.399646 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-a5da03b4-5516-49ed-8740-94c26778c89d tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "GET /compute/v2.1/servers/e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7" status: 200 len: 1523 microversion: 2.1 time: 0.297619 May 19 21:33:38.407665 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 100/190] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:33:38 2022] GET /compute/v2.1/servers/e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7 => generated 1523 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:33:38.541499 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-274d852c-cbc2-4260-bc1a-1c7ef8f95c15 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47575a76d62b4a109fda03f4bf016fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c4f4baaf8f4a258171bf97abdc8905', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:33:38.557932 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-274d852c-cbc2-4260-bc1a-1c7ef8f95c15 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] 10.222.0.65 "GET /compute/v2.1/servers/e8bc93c6-b778-4b19-b0e7-a069570e9b12" status: 200 len: 1314 microversion: 2.1 time: 0.298972 May 19 21:33:38.559986 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 91/191] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:33:38 2022] GET /compute/v2.1/servers/e8bc93c6-b778-4b19-b0e7-a069570e9b12 => generated 1314 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 21:33:38.656995 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [req-53a280e0-426d-478a-8f46-47f38dfe2ef6 req-cecf2e70-3704-4117-8934-a8c1327b67bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8bc93c6-b778-4b19-b0e7-a069570e9b12", "name": "network-vif-plugged", "status": "completed", "tag": "458b882d-119e-4370-9bf2-e32c9066475d"}]} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:33:38.667030 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=1 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:33:38.671756 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-53a280e0-426d-478a-8f46-47f38dfe2ef6 req-cecf2e70-3704-4117-8934-a8c1327b67bf service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:38.672733 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-53a280e0-426d-478a-8f46-47f38dfe2ef6 req-cecf2e70-3704-4117-8934-a8c1327b67bf service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:38.694535 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.compute.server_external_events [req-53a280e0-426d-478a-8f46-47f38dfe2ef6 req-cecf2e70-3704-4117-8934-a8c1327b67bf service nova] Creating event network-vif-plugged:458b882d-119e-4370-9bf2-e32c9066475d for instance e8bc93c6-b778-4b19-b0e7-a069570e9b12 on hv-cinder-83563 May 19 21:33:38.710910 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [req-53a280e0-426d-478a-8f46-47f38dfe2ef6 req-cecf2e70-3704-4117-8934-a8c1327b67bf service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061380 May 19 21:33:38.712411 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 101/192] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 21:33:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 21:33:39.429233 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-d094632e-8b39-46db-a058-346a54eb7759 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:33:39.431749 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-d094632e-8b39-46db-a058-346a54eb7759 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:33:39.450714 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-d094632e-8b39-46db-a058-346a54eb7759 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:39.452434 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-d094632e-8b39-46db-a058-346a54eb7759 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:39.453661 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-d094632e-8b39-46db-a058-346a54eb7759 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:39.454510 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-d094632e-8b39-46db-a058-346a54eb7759 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:39.593470 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-2f5ae02e-6e7f-464c-b5e3-edb8a247b85b tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:33:39.613691 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-2f5ae02e-6e7f-464c-b5e3-edb8a247b85b tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] [instance: e8bc93c6-b778-4b19-b0e7-a069570e9b12] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:33:39.637979 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2f5ae02e-6e7f-464c-b5e3-edb8a247b85b tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:39.643183 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2f5ae02e-6e7f-464c-b5e3-edb8a247b85b tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:39.644951 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2f5ae02e-6e7f-464c-b5e3-edb8a247b85b tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:39.646032 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2f5ae02e-6e7f-464c-b5e3-edb8a247b85b tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:39.747156 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-d094632e-8b39-46db-a058-346a54eb7759 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1589968f375946a38e82ec484afc837f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c62c1f3c54f568abdac37360ab457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:33:39.762546 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-d094632e-8b39-46db-a058-346a54eb7759 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "GET /compute/v2.1/servers/e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7" status: 200 len: 1523 microversion: 2.1 time: 0.338090 May 19 21:33:39.764040 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 92/193] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:33:39 2022] GET /compute/v2.1/servers/e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7 => generated 1523 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:33:39.917120 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-2f5ae02e-6e7f-464c-b5e3-edb8a247b85b tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47575a76d62b4a109fda03f4bf016fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c4f4baaf8f4a258171bf97abdc8905', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:33:39.936201 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-2f5ae02e-6e7f-464c-b5e3-edb8a247b85b tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] 10.222.0.65 "GET /compute/v2.1/servers/e8bc93c6-b778-4b19-b0e7-a069570e9b12" status: 200 len: 1314 microversion: 2.1 time: 0.360812 May 19 21:33:39.937661 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 102/194] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:33:39 2022] GET /compute/v2.1/servers/e8bc93c6-b778-4b19-b0e7-a069570e9b12 => generated 1314 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:33:40.806498 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-ee93ab14-5c29-42c2-a281-b08fd001d59d tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:33:40.807923 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-ee93ab14-5c29-42c2-a281-b08fd001d59d tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:33:40.828880 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ee93ab14-5c29-42c2-a281-b08fd001d59d tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:40.834312 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ee93ab14-5c29-42c2-a281-b08fd001d59d tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:40.840866 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ee93ab14-5c29-42c2-a281-b08fd001d59d tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:40.841630 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ee93ab14-5c29-42c2-a281-b08fd001d59d tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:40.965530 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-6c53e195-68eb-479e-be67-134f310ff2ad tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:33:40.966412 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-6c53e195-68eb-479e-be67-134f310ff2ad tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] [instance: e8bc93c6-b778-4b19-b0e7-a069570e9b12] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:33:40.983992 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6c53e195-68eb-479e-be67-134f310ff2ad tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:40.988815 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6c53e195-68eb-479e-be67-134f310ff2ad tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:40.992275 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6c53e195-68eb-479e-be67-134f310ff2ad tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:40.993898 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6c53e195-68eb-479e-be67-134f310ff2ad tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:41.029149 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell1:SELECT=100 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:33:41.180368 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-ee93ab14-5c29-42c2-a281-b08fd001d59d tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1589968f375946a38e82ec484afc837f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c62c1f3c54f568abdac37360ab457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:33:41.195079 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-ee93ab14-5c29-42c2-a281-b08fd001d59d tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "GET /compute/v2.1/servers/e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7" status: 200 len: 1523 microversion: 2.1 time: 0.410239 May 19 21:33:41.196067 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 93/195] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:33:40 2022] GET /compute/v2.1/servers/e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7 => generated 1523 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:33:41.210538 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-6c53e195-68eb-479e-be67-134f310ff2ad tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47575a76d62b4a109fda03f4bf016fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c4f4baaf8f4a258171bf97abdc8905', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:33:41.223535 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-6c53e195-68eb-479e-be67-134f310ff2ad tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] 10.222.0.65 "GET /compute/v2.1/servers/e8bc93c6-b778-4b19-b0e7-a069570e9b12" status: 200 len: 1314 microversion: 2.1 time: 0.263083 May 19 21:33:41.224413 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 103/196] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:33:40 2022] GET /compute/v2.1/servers/e8bc93c6-b778-4b19-b0e7-a069570e9b12 => generated 1314 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:33:42.226758 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-660c8c5f-91ac-4417-b227-09a061a89d6b tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:33:42.227707 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-660c8c5f-91ac-4417-b227-09a061a89d6b tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:33:42.234795 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-660c8c5f-91ac-4417-b227-09a061a89d6b tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:42.235264 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-660c8c5f-91ac-4417-b227-09a061a89d6b tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:42.236067 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-660c8c5f-91ac-4417-b227-09a061a89d6b tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:42.236503 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-660c8c5f-91ac-4417-b227-09a061a89d6b tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:42.256856 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-9e3735dc-3702-4d7e-afd2-d2be81e23085 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:33:42.259468 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-9e3735dc-3702-4d7e-afd2-d2be81e23085 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] [instance: e8bc93c6-b778-4b19-b0e7-a069570e9b12] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:33:42.279095 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9e3735dc-3702-4d7e-afd2-d2be81e23085 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:42.279866 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9e3735dc-3702-4d7e-afd2-d2be81e23085 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:42.281278 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9e3735dc-3702-4d7e-afd2-d2be81e23085 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:42.282567 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9e3735dc-3702-4d7e-afd2-d2be81e23085 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:42.500623 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-660c8c5f-91ac-4417-b227-09a061a89d6b tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1589968f375946a38e82ec484afc837f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c62c1f3c54f568abdac37360ab457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:33:42.510938 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-660c8c5f-91ac-4417-b227-09a061a89d6b tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "GET /compute/v2.1/servers/e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7" status: 200 len: 1523 microversion: 2.1 time: 0.288088 May 19 21:33:42.511531 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 94/197] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:33:42 2022] GET /compute/v2.1/servers/e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7 => generated 1523 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:33:42.543661 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-9e3735dc-3702-4d7e-afd2-d2be81e23085 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47575a76d62b4a109fda03f4bf016fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c4f4baaf8f4a258171bf97abdc8905', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:33:42.553280 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-9e3735dc-3702-4d7e-afd2-d2be81e23085 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] 10.222.0.65 "GET /compute/v2.1/servers/e8bc93c6-b778-4b19-b0e7-a069570e9b12" status: 200 len: 1497 microversion: 2.1 time: 0.304553 May 19 21:33:42.554463 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 104/198] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:33:42 2022] GET /compute/v2.1/servers/e8bc93c6-b778-4b19-b0e7-a069570e9b12 => generated 1497 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:33:43.543327 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-2051ada6-8257-4802-94e0-9bb86fbbc52a tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:33:43.545440 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-2051ada6-8257-4802-94e0-9bb86fbbc52a tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:33:43.553437 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-2051ada6-8257-4802-94e0-9bb86fbbc52a tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:43.553879 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-2051ada6-8257-4802-94e0-9bb86fbbc52a tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:43.554938 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-2051ada6-8257-4802-94e0-9bb86fbbc52a tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:43.555371 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-2051ada6-8257-4802-94e0-9bb86fbbc52a tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:43.766285 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-2051ada6-8257-4802-94e0-9bb86fbbc52a tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1589968f375946a38e82ec484afc837f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c62c1f3c54f568abdac37360ab457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:33:43.770730 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-5143239d-1e79-42a9-b9fa-947b9ca46717 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:33:43.773248 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-5143239d-1e79-42a9-b9fa-947b9ca46717 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] [instance: e8bc93c6-b778-4b19-b0e7-a069570e9b12] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:33:43.776248 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-2051ada6-8257-4802-94e0-9bb86fbbc52a tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "GET /compute/v2.1/servers/e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7" status: 200 len: 1523 microversion: 2.1 time: 0.239454 May 19 21:33:43.776867 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 95/199] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:33:43 2022] GET /compute/v2.1/servers/e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7 => generated 1523 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:33:43.792449 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5143239d-1e79-42a9-b9fa-947b9ca46717 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:43.793485 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5143239d-1e79-42a9-b9fa-947b9ca46717 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:43.794930 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5143239d-1e79-42a9-b9fa-947b9ca46717 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:43.795700 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5143239d-1e79-42a9-b9fa-947b9ca46717 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:43.850143 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-5143239d-1e79-42a9-b9fa-947b9ca46717 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] [instance: e8bc93c6-b778-4b19-b0e7-a069570e9b12] Going to try to terminate instance {{(pid=124350) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 21:33:43.995914 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-5143239d-1e79-42a9-b9fa-947b9ca46717 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] 10.222.0.65 "DELETE /compute/v2.1/servers/e8bc93c6-b778-4b19-b0e7-a069570e9b12" status: 204 len: 0 microversion: 2.1 time: 0.241824 May 19 21:33:43.997342 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 105/200] 10.222.0.65 () {58 vars in 1238 bytes} [Thu May 19 21:33:43 2022] DELETE /compute/v2.1/servers/e8bc93c6-b778-4b19-b0e7-a069570e9b12 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 19 21:33:44.012395 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-6ee91903-0f84-4583-8665-4b6fce100d33 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:33:44.013684 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-6ee91903-0f84-4583-8665-4b6fce100d33 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] [instance: e8bc93c6-b778-4b19-b0e7-a069570e9b12] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:33:44.031728 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-6ee91903-0f84-4583-8665-4b6fce100d33 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:44.032848 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-6ee91903-0f84-4583-8665-4b6fce100d33 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:44.034770 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-6ee91903-0f84-4583-8665-4b6fce100d33 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:44.035435 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-6ee91903-0f84-4583-8665-4b6fce100d33 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:44.274653 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-6ee91903-0f84-4583-8665-4b6fce100d33 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47575a76d62b4a109fda03f4bf016fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c4f4baaf8f4a258171bf97abdc8905', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:33:44.284477 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-6ee91903-0f84-4583-8665-4b6fce100d33 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] 10.222.0.65 "GET /compute/v2.1/servers/e8bc93c6-b778-4b19-b0e7-a069570e9b12" status: 200 len: 1503 microversion: 2.1 time: 0.280297 May 19 21:33:44.285953 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 96/201] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:33:44 2022] GET /compute/v2.1/servers/e8bc93c6-b778-4b19-b0e7-a069570e9b12 => generated 1503 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:33:44.808501 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-ada4a57a-0d60-4950-b3c4-bd85c061f1ee tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:33:44.809411 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-ada4a57a-0d60-4950-b3c4-bd85c061f1ee tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:33:44.825572 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ada4a57a-0d60-4950-b3c4-bd85c061f1ee tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:44.825572 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ada4a57a-0d60-4950-b3c4-bd85c061f1ee tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:44.825572 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ada4a57a-0d60-4950-b3c4-bd85c061f1ee tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:44.826687 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ada4a57a-0d60-4950-b3c4-bd85c061f1ee tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:45.101864 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-ada4a57a-0d60-4950-b3c4-bd85c061f1ee tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1589968f375946a38e82ec484afc837f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c62c1f3c54f568abdac37360ab457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:33:45.112577 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-ada4a57a-0d60-4950-b3c4-bd85c061f1ee tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "GET /compute/v2.1/servers/e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7" status: 200 len: 1523 microversion: 2.1 time: 0.311918 May 19 21:33:45.114102 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 106/202] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:33:44 2022] GET /compute/v2.1/servers/e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7 => generated 1523 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:33:45.312793 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-be907329-9c83-4c20-9842-8e8fcb074911 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:33:45.313961 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-be907329-9c83-4c20-9842-8e8fcb074911 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] [instance: e8bc93c6-b778-4b19-b0e7-a069570e9b12] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:33:45.322419 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-be907329-9c83-4c20-9842-8e8fcb074911 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:45.322927 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-be907329-9c83-4c20-9842-8e8fcb074911 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:45.323900 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-be907329-9c83-4c20-9842-8e8fcb074911 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:45.324504 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-be907329-9c83-4c20-9842-8e8fcb074911 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:45.556425 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-be907329-9c83-4c20-9842-8e8fcb074911 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47575a76d62b4a109fda03f4bf016fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c4f4baaf8f4a258171bf97abdc8905', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:33:45.573084 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-be907329-9c83-4c20-9842-8e8fcb074911 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] 10.222.0.65 "GET /compute/v2.1/servers/e8bc93c6-b778-4b19-b0e7-a069570e9b12" status: 200 len: 1503 microversion: 2.1 time: 0.266603 May 19 21:33:45.583069 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 97/203] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:33:45 2022] GET /compute/v2.1/servers/e8bc93c6-b778-4b19-b0e7-a069570e9b12 => generated 1503 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:33:46.140838 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-f0c7a64f-448b-43b4-a44c-73e98b898270 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:33:46.142161 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-f0c7a64f-448b-43b4-a44c-73e98b898270 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:33:46.155729 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f0c7a64f-448b-43b4-a44c-73e98b898270 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:46.159404 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f0c7a64f-448b-43b4-a44c-73e98b898270 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:46.160903 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f0c7a64f-448b-43b4-a44c-73e98b898270 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:46.161795 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f0c7a64f-448b-43b4-a44c-73e98b898270 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:46.468766 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-f0c7a64f-448b-43b4-a44c-73e98b898270 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1589968f375946a38e82ec484afc837f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c62c1f3c54f568abdac37360ab457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:33:46.482896 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-f0c7a64f-448b-43b4-a44c-73e98b898270 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "GET /compute/v2.1/servers/e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7" status: 200 len: 1523 microversion: 2.1 time: 0.347205 May 19 21:33:46.483870 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 107/204] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:33:46 2022] GET /compute/v2.1/servers/e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7 => generated 1523 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 21:33:46.604503 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-84ecff2c-7e5d-4667-9bff-fcf835ff552d tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:33:46.609654 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-84ecff2c-7e5d-4667-9bff-fcf835ff552d tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] [instance: e8bc93c6-b778-4b19-b0e7-a069570e9b12] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:33:46.642394 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-84ecff2c-7e5d-4667-9bff-fcf835ff552d tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:46.647490 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-84ecff2c-7e5d-4667-9bff-fcf835ff552d tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:46.652169 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-84ecff2c-7e5d-4667-9bff-fcf835ff552d tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:46.654857 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-84ecff2c-7e5d-4667-9bff-fcf835ff552d tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:46.722950 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [req-7b0f296f-9857-4295-b950-5c9f3ccced6b req-175ac7a0-3709-41d6-92de-a65efd2389c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8bc93c6-b778-4b19-b0e7-a069570e9b12", "name": "network-vif-deleted", "tag": "458b882d-119e-4370-9bf2-e32c9066475d"}]} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:33:46.795259 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-7b0f296f-9857-4295-b950-5c9f3ccced6b req-175ac7a0-3709-41d6-92de-a65efd2389c5 service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:46.797571 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-7b0f296f-9857-4295-b950-5c9f3ccced6b req-175ac7a0-3709-41d6-92de-a65efd2389c5 service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:46.838458 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-84ecff2c-7e5d-4667-9bff-fcf835ff552d tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47575a76d62b4a109fda03f4bf016fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c4f4baaf8f4a258171bf97abdc8905', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:33:46.851000 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-84ecff2c-7e5d-4667-9bff-fcf835ff552d tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] 10.222.0.65 "GET /compute/v2.1/servers/e8bc93c6-b778-4b19-b0e7-a069570e9b12" status: 200 len: 1461 microversion: 2.1 time: 0.256243 May 19 21:33:46.864410 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 98/205] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:33:46 2022] GET /compute/v2.1/servers/e8bc93c6-b778-4b19-b0e7-a069570e9b12 => generated 1461 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:33:46.874584 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.compute.server_external_events [req-7b0f296f-9857-4295-b950-5c9f3ccced6b req-175ac7a0-3709-41d6-92de-a65efd2389c5 service nova] Creating event network-vif-deleted:458b882d-119e-4370-9bf2-e32c9066475d for instance e8bc93c6-b778-4b19-b0e7-a069570e9b12 on hv-cinder-83563 May 19 21:33:46.899507 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [req-7b0f296f-9857-4295-b950-5c9f3ccced6b req-175ac7a0-3709-41d6-92de-a65efd2389c5 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.186670 May 19 21:33:46.907501 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 108/206] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 21:33:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 21:33:47.510893 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-68889521-a001-4186-bbfc-75e42e68ece2 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:33:47.511509 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-68889521-a001-4186-bbfc-75e42e68ece2 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:33:47.524002 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-68889521-a001-4186-bbfc-75e42e68ece2 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:47.524002 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-68889521-a001-4186-bbfc-75e42e68ece2 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:47.524002 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-68889521-a001-4186-bbfc-75e42e68ece2 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:47.524002 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-68889521-a001-4186-bbfc-75e42e68ece2 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:47.778276 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-68889521-a001-4186-bbfc-75e42e68ece2 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1589968f375946a38e82ec484afc837f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c62c1f3c54f568abdac37360ab457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:33:47.787995 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-68889521-a001-4186-bbfc-75e42e68ece2 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "GET /compute/v2.1/servers/e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7" status: 200 len: 1523 microversion: 2.1 time: 0.281059 May 19 21:33:47.798335 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 99/207] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:33:47 2022] GET /compute/v2.1/servers/e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7 => generated 1523 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:33:47.875466 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-cd5f91c6-42d9-453c-84e2-21a739969deb tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:33:47.877540 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-cd5f91c6-42d9-453c-84e2-21a739969deb tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] [instance: e8bc93c6-b778-4b19-b0e7-a069570e9b12] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:33:47.887654 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cd5f91c6-42d9-453c-84e2-21a739969deb tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:47.888432 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cd5f91c6-42d9-453c-84e2-21a739969deb tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:47.889644 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cd5f91c6-42d9-453c-84e2-21a739969deb tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:47.890415 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cd5f91c6-42d9-453c-84e2-21a739969deb tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:47.935752 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cd5f91c6-42d9-453c-84e2-21a739969deb tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:47.936199 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cd5f91c6-42d9-453c-84e2-21a739969deb tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:47.936677 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.objects.instance [None req-cd5f91c6-42d9-453c-84e2-21a739969deb tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lazy-loading 'fault' on Instance uuid e8bc93c6-b778-4b19-b0e7-a069570e9b12 {{(pid=124350) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 21:33:48.023715 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-cd5f91c6-42d9-453c-84e2-21a739969deb tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47575a76d62b4a109fda03f4bf016fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c4f4baaf8f4a258171bf97abdc8905', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:33:48.039112 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-cd5f91c6-42d9-453c-84e2-21a739969deb tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] 10.222.0.65 "GET /compute/v2.1/servers/e8bc93c6-b778-4b19-b0e7-a069570e9b12" status: 200 len: 1304 microversion: 2.1 time: 0.172775 May 19 21:33:48.040069 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 109/208] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:33:47 2022] GET /compute/v2.1/servers/e8bc93c6-b778-4b19-b0e7-a069570e9b12 => generated 1304 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 21:33:48.815615 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-576d901e-09a7-4e3a-a02e-dc045c522efd tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:33:48.817176 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-576d901e-09a7-4e3a-a02e-dc045c522efd tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:33:48.820043 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=3 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:33:48.832852 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-576d901e-09a7-4e3a-a02e-dc045c522efd tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:48.833730 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-576d901e-09a7-4e3a-a02e-dc045c522efd tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:48.835111 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-576d901e-09a7-4e3a-a02e-dc045c522efd tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:48.835858 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-576d901e-09a7-4e3a-a02e-dc045c522efd tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:49.067059 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-cd7403ae-fed8-4bb3-978d-54f4bed612f5 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:33:49.068054 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-cd7403ae-fed8-4bb3-978d-54f4bed612f5 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] [instance: e8bc93c6-b778-4b19-b0e7-a069570e9b12] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:33:49.084599 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cd7403ae-fed8-4bb3-978d-54f4bed612f5 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:49.097209 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-576d901e-09a7-4e3a-a02e-dc045c522efd tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1589968f375946a38e82ec484afc837f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c62c1f3c54f568abdac37360ab457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:33:49.100355 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cd7403ae-fed8-4bb3-978d-54f4bed612f5 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:49.104744 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cd7403ae-fed8-4bb3-978d-54f4bed612f5 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:49.107125 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cd7403ae-fed8-4bb3-978d-54f4bed612f5 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:49.115572 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-576d901e-09a7-4e3a-a02e-dc045c522efd tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "GET /compute/v2.1/servers/e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7" status: 200 len: 1523 microversion: 2.1 time: 0.305399 May 19 21:33:49.117848 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 100/209] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:33:48 2022] GET /compute/v2.1/servers/e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7 => generated 1523 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:33:49.189581 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cd7403ae-fed8-4bb3-978d-54f4bed612f5 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:49.190415 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cd7403ae-fed8-4bb3-978d-54f4bed612f5 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:49.191365 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.objects.instance [None req-cd7403ae-fed8-4bb3-978d-54f4bed612f5 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lazy-loading 'fault' on Instance uuid e8bc93c6-b778-4b19-b0e7-a069570e9b12 {{(pid=124350) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 21:33:49.250035 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-cd7403ae-fed8-4bb3-978d-54f4bed612f5 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47575a76d62b4a109fda03f4bf016fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c4f4baaf8f4a258171bf97abdc8905', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:33:49.265713 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-cd7403ae-fed8-4bb3-978d-54f4bed612f5 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] 10.222.0.65 "GET /compute/v2.1/servers/e8bc93c6-b778-4b19-b0e7-a069570e9b12" status: 200 len: 1304 microversion: 2.1 time: 0.204854 May 19 21:33:49.267629 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 110/210] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:33:49 2022] GET /compute/v2.1/servers/e8bc93c6-b778-4b19-b0e7-a069570e9b12 => generated 1304 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 21:33:50.137699 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-646191ad-3f16-4798-b481-090456ee4fbd tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:33:50.139534 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-646191ad-3f16-4798-b481-090456ee4fbd tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:33:50.148496 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-646191ad-3f16-4798-b481-090456ee4fbd tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:50.149393 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-646191ad-3f16-4798-b481-090456ee4fbd tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:50.150495 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-646191ad-3f16-4798-b481-090456ee4fbd tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:50.151121 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-646191ad-3f16-4798-b481-090456ee4fbd tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:50.291836 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-07bad450-9bc0-4310-aa5e-6c4076b32c55 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:33:50.293951 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-07bad450-9bc0-4310-aa5e-6c4076b32c55 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] [instance: e8bc93c6-b778-4b19-b0e7-a069570e9b12] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:33:50.304472 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-07bad450-9bc0-4310-aa5e-6c4076b32c55 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:50.304954 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-07bad450-9bc0-4310-aa5e-6c4076b32c55 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:50.306096 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-07bad450-9bc0-4310-aa5e-6c4076b32c55 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:50.306821 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-07bad450-9bc0-4310-aa5e-6c4076b32c55 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:50.415932 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-07bad450-9bc0-4310-aa5e-6c4076b32c55 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:50.435313 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-07bad450-9bc0-4310-aa5e-6c4076b32c55 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:50.436644 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.objects.instance [None req-07bad450-9bc0-4310-aa5e-6c4076b32c55 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lazy-loading 'fault' on Instance uuid e8bc93c6-b778-4b19-b0e7-a069570e9b12 {{(pid=124350) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 21:33:50.518963 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-07bad450-9bc0-4310-aa5e-6c4076b32c55 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47575a76d62b4a109fda03f4bf016fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c4f4baaf8f4a258171bf97abdc8905', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:33:50.539758 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-07bad450-9bc0-4310-aa5e-6c4076b32c55 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] 10.222.0.65 "GET /compute/v2.1/servers/e8bc93c6-b778-4b19-b0e7-a069570e9b12" status: 200 len: 1304 microversion: 2.1 time: 0.254538 May 19 21:33:50.541702 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 111/211] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:33:50 2022] GET /compute/v2.1/servers/e8bc93c6-b778-4b19-b0e7-a069570e9b12 => generated 1304 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:33:50.584011 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-646191ad-3f16-4798-b481-090456ee4fbd tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1589968f375946a38e82ec484afc837f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c62c1f3c54f568abdac37360ab457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:33:50.607160 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-646191ad-3f16-4798-b481-090456ee4fbd tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "GET /compute/v2.1/servers/e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7" status: 200 len: 1523 microversion: 2.1 time: 0.474686 May 19 21:33:50.608411 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 101/212] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:33:50 2022] GET /compute/v2.1/servers/e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7 => generated 1523 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:33:51.565010 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-2b556b79-06ce-48e8-90d4-c794e95bb4ee tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:33:51.565969 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-2b556b79-06ce-48e8-90d4-c794e95bb4ee tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] [instance: e8bc93c6-b778-4b19-b0e7-a069570e9b12] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:33:51.577676 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2b556b79-06ce-48e8-90d4-c794e95bb4ee tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:51.579767 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2b556b79-06ce-48e8-90d4-c794e95bb4ee tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:51.582054 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2b556b79-06ce-48e8-90d4-c794e95bb4ee tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:51.583091 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2b556b79-06ce-48e8-90d4-c794e95bb4ee tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:51.634974 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-f1c65aaf-6a89-46ad-bbbd-cdfbdc95da39 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:33:51.637013 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-f1c65aaf-6a89-46ad-bbbd-cdfbdc95da39 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:33:51.648244 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2b556b79-06ce-48e8-90d4-c794e95bb4ee tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:51.649375 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2b556b79-06ce-48e8-90d4-c794e95bb4ee tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:51.650462 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.objects.instance [None req-2b556b79-06ce-48e8-90d4-c794e95bb4ee tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lazy-loading 'fault' on Instance uuid e8bc93c6-b778-4b19-b0e7-a069570e9b12 {{(pid=124350) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 21:33:51.654434 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f1c65aaf-6a89-46ad-bbbd-cdfbdc95da39 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:51.656444 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f1c65aaf-6a89-46ad-bbbd-cdfbdc95da39 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:51.658505 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f1c65aaf-6a89-46ad-bbbd-cdfbdc95da39 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:51.661306 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f1c65aaf-6a89-46ad-bbbd-cdfbdc95da39 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:51.705581 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_cell1:SELECT=100 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:33:51.777508 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-2b556b79-06ce-48e8-90d4-c794e95bb4ee tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47575a76d62b4a109fda03f4bf016fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c4f4baaf8f4a258171bf97abdc8905', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:33:51.801520 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-2b556b79-06ce-48e8-90d4-c794e95bb4ee tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] 10.222.0.65 "GET /compute/v2.1/servers/e8bc93c6-b778-4b19-b0e7-a069570e9b12" status: 200 len: 1304 microversion: 2.1 time: 0.243543 May 19 21:33:51.810124 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 112/213] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:33:51 2022] GET /compute/v2.1/servers/e8bc93c6-b778-4b19-b0e7-a069570e9b12 => generated 1304 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:33:51.931001 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-f1c65aaf-6a89-46ad-bbbd-cdfbdc95da39 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1589968f375946a38e82ec484afc837f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c62c1f3c54f568abdac37360ab457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:33:51.941809 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-f1c65aaf-6a89-46ad-bbbd-cdfbdc95da39 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "GET /compute/v2.1/servers/e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7" status: 200 len: 1523 microversion: 2.1 time: 0.320006 May 19 21:33:51.943381 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 102/214] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:33:51 2022] GET /compute/v2.1/servers/e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7 => generated 1523 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:33:52.839533 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-8beaa7eb-816f-4999-a7bc-296d7e136e5b tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:33:52.840562 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-8beaa7eb-816f-4999-a7bc-296d7e136e5b tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] [instance: e8bc93c6-b778-4b19-b0e7-a069570e9b12] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:33:52.851651 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8beaa7eb-816f-4999-a7bc-296d7e136e5b tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:52.852300 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8beaa7eb-816f-4999-a7bc-296d7e136e5b tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:52.863799 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8beaa7eb-816f-4999-a7bc-296d7e136e5b tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:52.864921 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8beaa7eb-816f-4999-a7bc-296d7e136e5b tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:52.956230 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8beaa7eb-816f-4999-a7bc-296d7e136e5b tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:52.957845 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8beaa7eb-816f-4999-a7bc-296d7e136e5b tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:52.958850 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.objects.instance [None req-8beaa7eb-816f-4999-a7bc-296d7e136e5b tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lazy-loading 'fault' on Instance uuid e8bc93c6-b778-4b19-b0e7-a069570e9b12 {{(pid=124350) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 21:33:52.968013 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-2fc373c0-50c2-437a-ac24-b4f6b2f7ce08 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:33:52.969320 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-2fc373c0-50c2-437a-ac24-b4f6b2f7ce08 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:33:52.986781 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-2fc373c0-50c2-437a-ac24-b4f6b2f7ce08 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:52.987236 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-2fc373c0-50c2-437a-ac24-b4f6b2f7ce08 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:52.988045 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-2fc373c0-50c2-437a-ac24-b4f6b2f7ce08 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:52.988666 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-2fc373c0-50c2-437a-ac24-b4f6b2f7ce08 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:53.116303 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-8beaa7eb-816f-4999-a7bc-296d7e136e5b tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47575a76d62b4a109fda03f4bf016fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c4f4baaf8f4a258171bf97abdc8905', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:33:53.143594 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-8beaa7eb-816f-4999-a7bc-296d7e136e5b tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] 10.222.0.65 "GET /compute/v2.1/servers/e8bc93c6-b778-4b19-b0e7-a069570e9b12" status: 200 len: 1304 microversion: 2.1 time: 0.310842 May 19 21:33:53.161589 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 113/215] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:33:52 2022] GET /compute/v2.1/servers/e8bc93c6-b778-4b19-b0e7-a069570e9b12 => generated 1304 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 21:33:53.313307 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-2fc373c0-50c2-437a-ac24-b4f6b2f7ce08 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1589968f375946a38e82ec484afc837f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c62c1f3c54f568abdac37360ab457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:33:53.330815 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-2fc373c0-50c2-437a-ac24-b4f6b2f7ce08 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "GET /compute/v2.1/servers/e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7" status: 200 len: 1523 microversion: 2.1 time: 0.366403 May 19 21:33:53.332109 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 103/216] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:33:52 2022] GET /compute/v2.1/servers/e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7 => generated 1523 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 21:33:54.169577 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-4fa9cd1d-5219-4bef-a2f3-c528f42cfcda tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:33:54.171314 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-4fa9cd1d-5219-4bef-a2f3-c528f42cfcda tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] [instance: e8bc93c6-b778-4b19-b0e7-a069570e9b12] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:33:54.180879 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4fa9cd1d-5219-4bef-a2f3-c528f42cfcda tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:54.181577 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4fa9cd1d-5219-4bef-a2f3-c528f42cfcda tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:54.182600 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4fa9cd1d-5219-4bef-a2f3-c528f42cfcda tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:54.183185 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4fa9cd1d-5219-4bef-a2f3-c528f42cfcda tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:54.204194 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.wsgi [None req-4fa9cd1d-5219-4bef-a2f3-c528f42cfcda tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] HTTP exception thrown: Instance e8bc93c6-b778-4b19-b0e7-a069570e9b12 could not be found. May 19 21:33:54.207015 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-4fa9cd1d-5219-4bef-a2f3-c528f42cfcda tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Request method failure captured: May 19 21:33:54.207015 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: request: GET /compute/v2.1/servers/e8bc93c6-b778-4b19-b0e7-a069570e9b12 HTTP/1.1 May 19 21:33:54.207015 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Accept: application/json May 19 21:33:54.207015 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Accept-Encoding: identity May 19 21:33:54.207015 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Connection: close May 19 21:33:54.207015 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Content-Length: 0 May 19 21:33:54.207015 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Content-Type: application/json May 19 21:33:54.207015 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Host: 10.222.0.65 May 19 21:33:54.207015 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Openstack-System-Scope: None May 19 21:33:54.207015 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: User-Agent: python-urllib3/1.26.9 May 19 21:33:54.207015 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Auth-Token: gAAAAABihree51pjleWDuUTPwfAUNntWiYmbXZCEzZ_lVhZ3HLTnsojdxtVMVFZic78xHDYbKRF5OcJmkV4_2QxroF9tZyLMjs-XsEmdxOpGWcxgsjPGYzGrLYKep_DZ3bmDV97NRHQ0UtzOxIPPR-_I1PIIPxo151cHox8z6a1mqBdfMGDouLM May 19 21:33:54.207015 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Domain-Id: None May 19 21:33:54.207015 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Domain-Name: None May 19 21:33:54.207015 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Identity-Status: Confirmed May 19 21:33:54.207015 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Is-Admin-Project: True May 19 21:33:54.207015 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Project-Domain-Id: default May 19 21:33:54.207015 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Project-Domain-Name: Default May 19 21:33:54.207015 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Project-Id: f9c4f4baaf8f4a258171bf97abdc8905 May 19 21:33:54.207015 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Project-Name: tempest-VolumesActionsTest-1142953549 May 19 21:33:54.207015 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Role: reader,member May 19 21:33:54.207015 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Roles: reader,member May 19 21:33:54.208539 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/f9c4f4baaf8f4a258171bf97abdc8905"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/f9c4f4baaf8f4a258171bf97abdc8905"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_f9c4f4baaf8f4a258171bf97abdc8905"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/f9c4f4baaf8f4a258171bf97abdc8905"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}] May 19 21:33:54.208539 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Tenant: tempest-VolumesActionsTest-1142953549 May 19 21:33:54.208539 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Tenant-Id: f9c4f4baaf8f4a258171bf97abdc8905 May 19 21:33:54.208539 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Tenant-Name: tempest-VolumesActionsTest-1142953549 May 19 21:33:54.208539 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-User: tempest-VolumesActionsTest-1142953549-project May 19 21:33:54.208539 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-User-Domain-Id: default May 19 21:33:54.208539 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-User-Domain-Name: Default May 19 21:33:54.208539 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-User-Id: 47575a76d62b4a109fda03f4bf016fc6 May 19 21:33:54.208539 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-User-Name: tempest-VolumesActionsTest-1142953549-project May 19 21:33:54.208539 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: method: > May 19 21:33:54.208539 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: exception: Instance e8bc93c6-b778-4b19-b0e7-a069570e9b12 could not be found. May 19 21:33:54.208539 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: action_args: {'id': 'e8bc93c6-b778-4b19-b0e7-a069570e9b12'} May 19 21:33:54.209376 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 21:33:54.209376 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:33:54.209376 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 21:33:54.209376 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 21:33:54.209376 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 21:33:54.209376 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 21:33:54.209376 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 21:33:54.209376 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 21:33:54.209376 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 21:33:54.209376 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 21:33:54.209376 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8bc93c6-b778-4b19-b0e7-a069570e9b12 could not be found. May 19 21:33:54.209376 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi May 19 21:33:54.209376 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 21:33:54.209376 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi May 19 21:33:54.209376 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:33:54.209376 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 21:33:54.209376 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 21:33:54.209376 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 21:33:54.209376 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 21:33:54.209376 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 21:33:54.210776 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 21:33:54.210776 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 21:33:54.210776 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 21:33:54.210776 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 21:33:54.210776 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 21:33:54.210776 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 21:33:54.210776 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 21:33:54.210776 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8bc93c6-b778-4b19-b0e7-a069570e9b12 could not be found. May 19 21:33:54.210776 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi May 19 21:33:54.210776 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 21:33:54.210776 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi May 19 21:33:54.210776 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:33:54.210776 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 21:33:54.210776 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 21:33:54.210776 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 21:33:54.210776 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 21:33:54.210776 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8bc93c6-b778-4b19-b0e7-a069570e9b12 could not be found. May 19 21:33:54.210776 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi May 19 21:33:54.213231 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-4fa9cd1d-5219-4bef-a2f3-c528f42cfcda tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Returning 404 to user: Instance e8bc93c6-b778-4b19-b0e7-a069570e9b12 could not be found. {{(pid=124350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 21:33:54.214798 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-4fa9cd1d-5219-4bef-a2f3-c528f42cfcda tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] 10.222.0.65 "GET /compute/v2.1/servers/e8bc93c6-b778-4b19-b0e7-a069570e9b12" status: 404 len: 111 microversion: 2.1 time: 0.050987 May 19 21:33:54.220359 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 114/217] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:33:54 2022] GET /compute/v2.1/servers/e8bc93c6-b778-4b19-b0e7-a069570e9b12 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 21:33:54.356871 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-6b5a98cc-1148-4411-af93-6766abbfc165 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:33:54.358087 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-6b5a98cc-1148-4411-af93-6766abbfc165 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:33:54.379932 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-6b5a98cc-1148-4411-af93-6766abbfc165 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:54.382582 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-6b5a98cc-1148-4411-af93-6766abbfc165 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:54.385994 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-6b5a98cc-1148-4411-af93-6766abbfc165 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:54.386600 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-6b5a98cc-1148-4411-af93-6766abbfc165 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:54.414373 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-e2866c46-3ab9-4958-9b7a-d7ff22f2c979 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-560914894", "imageRef": "a874457a-f8a8-46f6-bdcc-1fa632a0d3c0", "flavorRef": "452", "networks": [{"uuid": "dead0934-78cb-4aba-a85a-e1a39596f2e4"}]}} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:33:54.478306 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.network.neutron [None req-e2866c46-3ab9-4958-9b7a-d7ff22f2c979 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] validate_networks() for [('dead0934-78cb-4aba-a85a-e1a39596f2e4', None, None, None, None, None)] {{(pid=124350) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 19 21:33:54.884248 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-6b5a98cc-1148-4411-af93-6766abbfc165 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1589968f375946a38e82ec484afc837f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c62c1f3c54f568abdac37360ab457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:33:54.895045 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-6b5a98cc-1148-4411-af93-6766abbfc165 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "GET /compute/v2.1/servers/e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7" status: 200 len: 1523 microversion: 2.1 time: 0.543766 May 19 21:33:54.904894 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 104/218] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:33:54 2022] GET /compute/v2.1/servers/e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7 => generated 1523 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:33:55.038780 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.virt.hardware [None req-e2866c46-3ab9-4958-9b7a-d7ff22f2c979 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Flavor limits 0:0:0 {{(pid=124350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 21:33:55.040567 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.virt.hardware [None req-e2866c46-3ab9-4958-9b7a-d7ff22f2c979 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Image limits 0:0:0 {{(pid=124350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 21:33:55.041820 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.virt.hardware [None req-e2866c46-3ab9-4958-9b7a-d7ff22f2c979 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Flavor pref 0:0:0 {{(pid=124350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 21:33:55.042875 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.virt.hardware [None req-e2866c46-3ab9-4958-9b7a-d7ff22f2c979 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Image pref 0:0:0 {{(pid=124350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 21:33:55.043818 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.virt.hardware [None req-e2866c46-3ab9-4958-9b7a-d7ff22f2c979 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 21:33:55.090414 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e2866c46-3ab9-4958-9b7a-d7ff22f2c979 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:55.093827 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e2866c46-3ab9-4958-9b7a-d7ff22f2c979 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:55.095111 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e2866c46-3ab9-4958-9b7a-d7ff22f2c979 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:55.098366 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e2866c46-3ab9-4958-9b7a-d7ff22f2c979 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:55.144055 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.quota [None req-e2866c46-3ab9-4958-9b7a-d7ff22f2c979 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Getting quotas for project f9c4f4baaf8f4a258171bf97abdc8905. Resources: {'ram', 'cores', 'instances'} {{(pid=124350) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 21:33:55.152505 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.quota [None req-e2866c46-3ab9-4958-9b7a-d7ff22f2c979 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Getting quotas for user 47575a76d62b4a109fda03f4bf016fc6 and project f9c4f4baaf8f4a258171bf97abdc8905. Resources: {'ram', 'cores', 'instances'} {{(pid=124350) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 21:33:55.176378 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-e2866c46-3ab9-4958-9b7a-d7ff22f2c979 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Going to run 1 instances... {{(pid=124350) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 21:33:55.182612 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-e2866c46-3ab9-4958-9b7a-d7ff22f2c979 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] [instance: 4a2fe4f6-f020-4fdc-bb72-ffe298b56627] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a874457a-f8a8-46f6-bdcc-1fa632a0d3c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124350) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 21:33:55.311380 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-e2866c46-3ab9-4958-9b7a-d7ff22f2c979 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.905510 May 19 21:33:55.312129 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 115/219] 10.222.0.65 () {60 vars in 1146 bytes} [Thu May 19 21:33:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 907 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 21:33:55.329526 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-53cee779-3268-4c59-980b-98a45b7da1d2 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:33:55.339300 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-53cee779-3268-4c59-980b-98a45b7da1d2 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] [instance: 4a2fe4f6-f020-4fdc-bb72-ffe298b56627] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:33:55.918382 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-32958da7-11f6-4647-9d1b-6c31c03c7346 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:33:55.923328 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-32958da7-11f6-4647-9d1b-6c31c03c7346 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:33:55.953459 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-32958da7-11f6-4647-9d1b-6c31c03c7346 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:55.955090 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-32958da7-11f6-4647-9d1b-6c31c03c7346 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:55.957355 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-32958da7-11f6-4647-9d1b-6c31c03c7346 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:55.959647 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-32958da7-11f6-4647-9d1b-6c31c03c7346 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:56.034445 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-53cee779-3268-4c59-980b-98a45b7da1d2 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47575a76d62b4a109fda03f4bf016fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c4f4baaf8f4a258171bf97abdc8905', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:33:56.049151 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-53cee779-3268-4c59-980b-98a45b7da1d2 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] 10.222.0.65 "GET /compute/v2.1/servers/4a2fe4f6-f020-4fdc-bb72-ffe298b56627" status: 200 len: 1213 microversion: 2.1 time: 0.729153 May 19 21:33:56.049731 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 105/220] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:33:55 2022] GET /compute/v2.1/servers/4a2fe4f6-f020-4fdc-bb72-ffe298b56627 => generated 1213 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:33:56.350754 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-32958da7-11f6-4647-9d1b-6c31c03c7346 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1589968f375946a38e82ec484afc837f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c62c1f3c54f568abdac37360ab457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:33:56.371938 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-32958da7-11f6-4647-9d1b-6c31c03c7346 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "GET /compute/v2.1/servers/e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7" status: 200 len: 1503 microversion: 2.1 time: 0.461359 May 19 21:33:56.387740 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 116/221] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:33:55 2022] GET /compute/v2.1/servers/e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7 => generated 1503 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 21:33:56.409687 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-b9d43df9-76af-43b1-a88f-822139d307d5 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:33:56.439873 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-b9d43df9-76af-43b1-a88f-822139d307d5 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: a18b9269-6ed1-4af1-a0da-8260f38fbf39] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:33:56.478471 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-b9d43df9-76af-43b1-a88f-822139d307d5 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:56.479385 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-b9d43df9-76af-43b1-a88f-822139d307d5 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:56.480228 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-b9d43df9-76af-43b1-a88f-822139d307d5 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:56.480743 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-b9d43df9-76af-43b1-a88f-822139d307d5 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:56.958448 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-b9d43df9-76af-43b1-a88f-822139d307d5 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1589968f375946a38e82ec484afc837f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c62c1f3c54f568abdac37360ab457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:33:56.987477 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-b9d43df9-76af-43b1-a88f-822139d307d5 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "GET /compute/v2.1/servers/a18b9269-6ed1-4af1-a0da-8260f38fbf39" status: 200 len: 1517 microversion: 2.1 time: 0.588902 May 19 21:33:56.988527 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 106/222] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:33:56 2022] GET /compute/v2.1/servers/a18b9269-6ed1-4af1-a0da-8260f38fbf39 => generated 1517 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:33:57.080327 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-8fe190e8-e477-4127-aaaf-16db05ac1ae8 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:33:57.081688 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-8fe190e8-e477-4127-aaaf-16db05ac1ae8 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] [instance: 4a2fe4f6-f020-4fdc-bb72-ffe298b56627] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:33:57.124593 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8fe190e8-e477-4127-aaaf-16db05ac1ae8 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:57.125165 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8fe190e8-e477-4127-aaaf-16db05ac1ae8 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:57.128527 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8fe190e8-e477-4127-aaaf-16db05ac1ae8 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:57.129721 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8fe190e8-e477-4127-aaaf-16db05ac1ae8 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:57.308066 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-8fe190e8-e477-4127-aaaf-16db05ac1ae8 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47575a76d62b4a109fda03f4bf016fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c4f4baaf8f4a258171bf97abdc8905', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:33:57.335888 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-8fe190e8-e477-4127-aaaf-16db05ac1ae8 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] 10.222.0.65 "GET /compute/v2.1/servers/4a2fe4f6-f020-4fdc-bb72-ffe298b56627" status: 200 len: 1265 microversion: 2.1 time: 0.261894 May 19 21:33:57.337494 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 117/223] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:33:57 2022] GET /compute/v2.1/servers/4a2fe4f6-f020-4fdc-bb72-ffe298b56627 => generated 1265 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 21:33:58.359050 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-f933fae2-98e7-4e0c-b70d-f01f3830dd5b tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:33:58.360363 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-f933fae2-98e7-4e0c-b70d-f01f3830dd5b tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] [instance: 4a2fe4f6-f020-4fdc-bb72-ffe298b56627] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:33:58.399524 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f933fae2-98e7-4e0c-b70d-f01f3830dd5b tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:58.400154 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f933fae2-98e7-4e0c-b70d-f01f3830dd5b tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:58.401358 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f933fae2-98e7-4e0c-b70d-f01f3830dd5b tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:58.401974 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f933fae2-98e7-4e0c-b70d-f01f3830dd5b tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:58.726972 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-f933fae2-98e7-4e0c-b70d-f01f3830dd5b tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47575a76d62b4a109fda03f4bf016fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c4f4baaf8f4a258171bf97abdc8905', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:33:58.757899 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-f933fae2-98e7-4e0c-b70d-f01f3830dd5b tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] 10.222.0.65 "GET /compute/v2.1/servers/4a2fe4f6-f020-4fdc-bb72-ffe298b56627" status: 200 len: 1271 microversion: 2.1 time: 0.402451 May 19 21:33:58.762007 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 107/224] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:33:58 2022] GET /compute/v2.1/servers/4a2fe4f6-f020-4fdc-bb72-ffe298b56627 => generated 1271 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:33:59.042327 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-9160e816-7417-4e9f-93c1-8c3d2b791502 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:33:59.043530 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-9160e816-7417-4e9f-93c1-8c3d2b791502 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: a18b9269-6ed1-4af1-a0da-8260f38fbf39] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:33:59.063528 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9160e816-7417-4e9f-93c1-8c3d2b791502 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:59.074576 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9160e816-7417-4e9f-93c1-8c3d2b791502 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:59.077132 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9160e816-7417-4e9f-93c1-8c3d2b791502 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:59.080137 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9160e816-7417-4e9f-93c1-8c3d2b791502 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:59.141657 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.objects.instance [None req-9160e816-7417-4e9f-93c1-8c3d2b791502 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lazy-loading 'flavor' on Instance uuid a18b9269-6ed1-4af1-a0da-8260f38fbf39 {{(pid=124350) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 21:33:59.221089 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:33:59.553847 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-9160e816-7417-4e9f-93c1-8c3d2b791502 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "POST /compute/v2.1/servers/a18b9269-6ed1-4af1-a0da-8260f38fbf39/action" status: 200 len: 32 microversion: 2.1 time: 0.516382 May 19 21:33:59.560891 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 118/225] 10.222.0.65 () {60 vars in 1277 bytes} [Thu May 19 21:33:59 2022] POST /compute/v2.1/servers/a18b9269-6ed1-4af1-a0da-8260f38fbf39/action => generated 32 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 21:33:59.577777 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-10517815-b15c-4f7a-84ba-09a5dd0ff980 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:33:59.585211 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-10517815-b15c-4f7a-84ba-09a5dd0ff980 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: a18b9269-6ed1-4af1-a0da-8260f38fbf39] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:33:59.597513 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-10517815-b15c-4f7a-84ba-09a5dd0ff980 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:59.597978 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-10517815-b15c-4f7a-84ba-09a5dd0ff980 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:59.602481 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-10517815-b15c-4f7a-84ba-09a5dd0ff980 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:59.603205 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-10517815-b15c-4f7a-84ba-09a5dd0ff980 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:59.780924 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-198b7829-139f-4638-88be-24a4dbd729b6 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:33:59.788881 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-198b7829-139f-4638-88be-24a4dbd729b6 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] [instance: 4a2fe4f6-f020-4fdc-bb72-ffe298b56627] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:33:59.807691 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-198b7829-139f-4638-88be-24a4dbd729b6 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:59.808117 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-198b7829-139f-4638-88be-24a4dbd729b6 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:33:59.808906 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-198b7829-139f-4638-88be-24a4dbd729b6 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:33:59.809332 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-198b7829-139f-4638-88be-24a4dbd729b6 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:00.227808 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-10517815-b15c-4f7a-84ba-09a5dd0ff980 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1589968f375946a38e82ec484afc837f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c62c1f3c54f568abdac37360ab457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:34:00.259474 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-10517815-b15c-4f7a-84ba-09a5dd0ff980 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "GET /compute/v2.1/servers/a18b9269-6ed1-4af1-a0da-8260f38fbf39" status: 200 len: 1523 microversion: 2.1 time: 0.697841 May 19 21:34:00.260563 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 108/226] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:33:59 2022] GET /compute/v2.1/servers/a18b9269-6ed1-4af1-a0da-8260f38fbf39 => generated 1523 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:34:00.381598 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-198b7829-139f-4638-88be-24a4dbd729b6 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47575a76d62b4a109fda03f4bf016fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c4f4baaf8f4a258171bf97abdc8905', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:34:00.418511 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-198b7829-139f-4638-88be-24a4dbd729b6 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] 10.222.0.65 "GET /compute/v2.1/servers/4a2fe4f6-f020-4fdc-bb72-ffe298b56627" status: 200 len: 1313 microversion: 2.1 time: 0.642501 May 19 21:34:00.428501 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 119/227] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:33:59 2022] GET /compute/v2.1/servers/4a2fe4f6-f020-4fdc-bb72-ffe298b56627 => generated 1313 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 21:34:01.135705 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [req-7bf855a0-d4f9-41f9-8ca5-7e417e5ee83b req-e0a1c905-fec7-4680-aa62-0b33ba41a258 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a2fe4f6-f020-4fdc-bb72-ffe298b56627", "tag": "abeca8c2-0922-427b-bde2-2a81f568efa5"}]} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:34:01.192872 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-7bf855a0-d4f9-41f9-8ca5-7e417e5ee83b req-e0a1c905-fec7-4680-aa62-0b33ba41a258 service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:01.201099 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-7bf855a0-d4f9-41f9-8ca5-7e417e5ee83b req-e0a1c905-fec7-4680-aa62-0b33ba41a258 service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:01.292799 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-3a502515-b1bc-4265-bbfd-817eb25f12b1 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:34:01.294096 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-3a502515-b1bc-4265-bbfd-817eb25f12b1 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: a18b9269-6ed1-4af1-a0da-8260f38fbf39] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:34:01.327625 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.compute.server_external_events [req-7bf855a0-d4f9-41f9-8ca5-7e417e5ee83b req-e0a1c905-fec7-4680-aa62-0b33ba41a258 service nova] Creating event network-changed:abeca8c2-0922-427b-bde2-2a81f568efa5 for instance 4a2fe4f6-f020-4fdc-bb72-ffe298b56627 on hv-cinder-83563 May 19 21:34:01.334887 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3a502515-b1bc-4265-bbfd-817eb25f12b1 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:01.337572 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3a502515-b1bc-4265-bbfd-817eb25f12b1 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:01.341528 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3a502515-b1bc-4265-bbfd-817eb25f12b1 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:01.348149 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3a502515-b1bc-4265-bbfd-817eb25f12b1 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:01.365741 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [req-7bf855a0-d4f9-41f9-8ca5-7e417e5ee83b req-e0a1c905-fec7-4680-aa62-0b33ba41a258 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.239324 May 19 21:34:01.369956 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 109/228] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 21:34:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 21:34:01.449538 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-7e11d42d-d569-4fdb-99e2-4bdce0f1970e tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:34:01.457091 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-7e11d42d-d569-4fdb-99e2-4bdce0f1970e tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] [instance: 4a2fe4f6-f020-4fdc-bb72-ffe298b56627] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:34:01.488318 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-7e11d42d-d569-4fdb-99e2-4bdce0f1970e tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:01.489376 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-7e11d42d-d569-4fdb-99e2-4bdce0f1970e tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:01.491607 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-7e11d42d-d569-4fdb-99e2-4bdce0f1970e tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:01.492308 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-7e11d42d-d569-4fdb-99e2-4bdce0f1970e tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:02.209609 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-3a502515-b1bc-4265-bbfd-817eb25f12b1 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1589968f375946a38e82ec484afc837f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c62c1f3c54f568abdac37360ab457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:34:02.223425 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-3a502515-b1bc-4265-bbfd-817eb25f12b1 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "GET /compute/v2.1/servers/a18b9269-6ed1-4af1-a0da-8260f38fbf39" status: 200 len: 1523 microversion: 2.1 time: 0.937356 May 19 21:34:02.225303 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 120/229] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:34:01 2022] GET /compute/v2.1/servers/a18b9269-6ed1-4af1-a0da-8260f38fbf39 => generated 1523 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:34:02.233966 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-7e11d42d-d569-4fdb-99e2-4bdce0f1970e tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47575a76d62b4a109fda03f4bf016fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c4f4baaf8f4a258171bf97abdc8905', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:34:02.259425 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-7e11d42d-d569-4fdb-99e2-4bdce0f1970e tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] 10.222.0.65 "GET /compute/v2.1/servers/4a2fe4f6-f020-4fdc-bb72-ffe298b56627" status: 200 len: 1313 microversion: 2.1 time: 0.815640 May 19 21:34:02.261201 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 110/230] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:34:01 2022] GET /compute/v2.1/servers/4a2fe4f6-f020-4fdc-bb72-ffe298b56627 => generated 1313 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 21:34:03.262410 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-d590690d-8633-4457-a555-25fcdc19af0e tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:34:03.265179 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-d590690d-8633-4457-a555-25fcdc19af0e tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: a18b9269-6ed1-4af1-a0da-8260f38fbf39] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:34:03.277773 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d590690d-8633-4457-a555-25fcdc19af0e tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:03.281271 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d590690d-8633-4457-a555-25fcdc19af0e tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:03.283062 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d590690d-8633-4457-a555-25fcdc19af0e tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:03.283840 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d590690d-8633-4457-a555-25fcdc19af0e tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:03.289642 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-9eb14c8d-11e7-48a8-9602-1aa3077452e0 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:34:03.292124 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-9eb14c8d-11e7-48a8-9602-1aa3077452e0 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] [instance: 4a2fe4f6-f020-4fdc-bb72-ffe298b56627] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:34:03.306571 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-9eb14c8d-11e7-48a8-9602-1aa3077452e0 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:03.307712 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-9eb14c8d-11e7-48a8-9602-1aa3077452e0 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:03.309334 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-9eb14c8d-11e7-48a8-9602-1aa3077452e0 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:03.310329 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-9eb14c8d-11e7-48a8-9602-1aa3077452e0 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:03.644542 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-9eb14c8d-11e7-48a8-9602-1aa3077452e0 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47575a76d62b4a109fda03f4bf016fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c4f4baaf8f4a258171bf97abdc8905', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:34:03.661042 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-9eb14c8d-11e7-48a8-9602-1aa3077452e0 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] 10.222.0.65 "GET /compute/v2.1/servers/4a2fe4f6-f020-4fdc-bb72-ffe298b56627" status: 200 len: 1313 microversion: 2.1 time: 0.379093 May 19 21:34:03.673293 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 111/231] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:34:03 2022] GET /compute/v2.1/servers/4a2fe4f6-f020-4fdc-bb72-ffe298b56627 => generated 1313 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:34:03.812993 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-d590690d-8633-4457-a555-25fcdc19af0e tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1589968f375946a38e82ec484afc837f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c62c1f3c54f568abdac37360ab457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:34:03.829136 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-d590690d-8633-4457-a555-25fcdc19af0e tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "GET /compute/v2.1/servers/a18b9269-6ed1-4af1-a0da-8260f38fbf39" status: 200 len: 1523 microversion: 2.1 time: 0.575358 May 19 21:34:03.829972 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 121/232] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:34:03 2022] GET /compute/v2.1/servers/a18b9269-6ed1-4af1-a0da-8260f38fbf39 => generated 1523 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:34:04.682752 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-a2e097a9-8ae6-4a0c-a1f8-9775099e7c80 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:34:04.686904 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-a2e097a9-8ae6-4a0c-a1f8-9775099e7c80 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] [instance: 4a2fe4f6-f020-4fdc-bb72-ffe298b56627] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:34:04.701294 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a2e097a9-8ae6-4a0c-a1f8-9775099e7c80 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:04.701734 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a2e097a9-8ae6-4a0c-a1f8-9775099e7c80 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:04.702624 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a2e097a9-8ae6-4a0c-a1f8-9775099e7c80 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:04.703058 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a2e097a9-8ae6-4a0c-a1f8-9775099e7c80 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:04.849214 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-891bbdca-6dfc-4948-8dac-aaa67bcb1d3c tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:34:04.850809 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-891bbdca-6dfc-4948-8dac-aaa67bcb1d3c tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: a18b9269-6ed1-4af1-a0da-8260f38fbf39] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:34:04.867208 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-891bbdca-6dfc-4948-8dac-aaa67bcb1d3c tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:04.869141 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-891bbdca-6dfc-4948-8dac-aaa67bcb1d3c tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:04.871038 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-891bbdca-6dfc-4948-8dac-aaa67bcb1d3c tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:04.871734 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-891bbdca-6dfc-4948-8dac-aaa67bcb1d3c tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:04.925602 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-a2e097a9-8ae6-4a0c-a1f8-9775099e7c80 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47575a76d62b4a109fda03f4bf016fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c4f4baaf8f4a258171bf97abdc8905', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:34:04.933739 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-a2e097a9-8ae6-4a0c-a1f8-9775099e7c80 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] 10.222.0.65 "GET /compute/v2.1/servers/4a2fe4f6-f020-4fdc-bb72-ffe298b56627" status: 200 len: 1313 microversion: 2.1 time: 0.258369 May 19 21:34:04.934350 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 112/233] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:34:04 2022] GET /compute/v2.1/servers/4a2fe4f6-f020-4fdc-bb72-ffe298b56627 => generated 1313 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:34:05.122122 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell0:SELECT=2 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:34:05.165225 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell0:SELECT=6 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:34:05.641709 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-891bbdca-6dfc-4948-8dac-aaa67bcb1d3c tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1589968f375946a38e82ec484afc837f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c62c1f3c54f568abdac37360ab457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:34:05.656222 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-891bbdca-6dfc-4948-8dac-aaa67bcb1d3c tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "GET /compute/v2.1/servers/a18b9269-6ed1-4af1-a0da-8260f38fbf39" status: 200 len: 1523 microversion: 2.1 time: 0.811681 May 19 21:34:05.658459 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 122/234] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:34:04 2022] GET /compute/v2.1/servers/a18b9269-6ed1-4af1-a0da-8260f38fbf39 => generated 1523 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 21:34:05.956646 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-f99ad53c-11db-402c-8e85-4ff747115ad5 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:34:05.958046 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-f99ad53c-11db-402c-8e85-4ff747115ad5 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] [instance: 4a2fe4f6-f020-4fdc-bb72-ffe298b56627] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:34:05.978604 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f99ad53c-11db-402c-8e85-4ff747115ad5 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:05.979051 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f99ad53c-11db-402c-8e85-4ff747115ad5 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:05.983092 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f99ad53c-11db-402c-8e85-4ff747115ad5 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:05.983852 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f99ad53c-11db-402c-8e85-4ff747115ad5 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:06.049949 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_cell0:SELECT=2 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:34:06.341298 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-f99ad53c-11db-402c-8e85-4ff747115ad5 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47575a76d62b4a109fda03f4bf016fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c4f4baaf8f4a258171bf97abdc8905', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:34:06.369273 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-f99ad53c-11db-402c-8e85-4ff747115ad5 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] 10.222.0.65 "GET /compute/v2.1/servers/4a2fe4f6-f020-4fdc-bb72-ffe298b56627" status: 200 len: 1313 microversion: 2.1 time: 0.418432 May 19 21:34:06.372171 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 113/235] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:34:05 2022] GET /compute/v2.1/servers/4a2fe4f6-f020-4fdc-bb72-ffe298b56627 => generated 1313 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 21:34:06.686154 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-6fe42bce-b786-4610-b5b2-f9b0e1dc9100 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:34:06.688912 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-6fe42bce-b786-4610-b5b2-f9b0e1dc9100 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: a18b9269-6ed1-4af1-a0da-8260f38fbf39] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:34:06.700408 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6fe42bce-b786-4610-b5b2-f9b0e1dc9100 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:06.701504 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6fe42bce-b786-4610-b5b2-f9b0e1dc9100 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:06.702870 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6fe42bce-b786-4610-b5b2-f9b0e1dc9100 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:06.703669 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6fe42bce-b786-4610-b5b2-f9b0e1dc9100 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:06.949199 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-6fe42bce-b786-4610-b5b2-f9b0e1dc9100 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1589968f375946a38e82ec484afc837f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c62c1f3c54f568abdac37360ab457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:34:06.958607 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-6fe42bce-b786-4610-b5b2-f9b0e1dc9100 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "GET /compute/v2.1/servers/a18b9269-6ed1-4af1-a0da-8260f38fbf39" status: 200 len: 1523 microversion: 2.1 time: 0.281122 May 19 21:34:06.959206 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 123/236] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:34:06 2022] GET /compute/v2.1/servers/a18b9269-6ed1-4af1-a0da-8260f38fbf39 => generated 1523 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:34:07.396271 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-c3030076-7f63-49ba-b3fa-fec1a7a047c9 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:34:07.397067 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-c3030076-7f63-49ba-b3fa-fec1a7a047c9 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] [instance: 4a2fe4f6-f020-4fdc-bb72-ffe298b56627] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:34:07.406973 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c3030076-7f63-49ba-b3fa-fec1a7a047c9 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:07.407906 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c3030076-7f63-49ba-b3fa-fec1a7a047c9 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:07.409144 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c3030076-7f63-49ba-b3fa-fec1a7a047c9 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:07.409999 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c3030076-7f63-49ba-b3fa-fec1a7a047c9 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:07.717876 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-c3030076-7f63-49ba-b3fa-fec1a7a047c9 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47575a76d62b4a109fda03f4bf016fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c4f4baaf8f4a258171bf97abdc8905', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:34:07.728804 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-c3030076-7f63-49ba-b3fa-fec1a7a047c9 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] 10.222.0.65 "GET /compute/v2.1/servers/4a2fe4f6-f020-4fdc-bb72-ffe298b56627" status: 200 len: 1313 microversion: 2.1 time: 0.336568 May 19 21:34:07.738842 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 114/237] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:34:07 2022] GET /compute/v2.1/servers/4a2fe4f6-f020-4fdc-bb72-ffe298b56627 => generated 1313 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:34:07.986148 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-8c9ec1e1-6814-411a-bd44-d7b95bb4215b tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:34:07.987398 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-8c9ec1e1-6814-411a-bd44-d7b95bb4215b tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: a18b9269-6ed1-4af1-a0da-8260f38fbf39] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:34:07.994678 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8c9ec1e1-6814-411a-bd44-d7b95bb4215b tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:07.995253 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8c9ec1e1-6814-411a-bd44-d7b95bb4215b tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:07.996091 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8c9ec1e1-6814-411a-bd44-d7b95bb4215b tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:07.996555 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8c9ec1e1-6814-411a-bd44-d7b95bb4215b tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:08.186759 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-8c9ec1e1-6814-411a-bd44-d7b95bb4215b tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1589968f375946a38e82ec484afc837f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c62c1f3c54f568abdac37360ab457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:34:08.212651 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-8c9ec1e1-6814-411a-bd44-d7b95bb4215b tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "GET /compute/v2.1/servers/a18b9269-6ed1-4af1-a0da-8260f38fbf39" status: 200 len: 1523 microversion: 2.1 time: 0.232295 May 19 21:34:08.213814 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 124/238] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:34:07 2022] GET /compute/v2.1/servers/a18b9269-6ed1-4af1-a0da-8260f38fbf39 => generated 1523 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:34:08.747063 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-38e0d8ae-1e51-4f7a-8adb-3dcee8ab180f tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:34:08.747860 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-38e0d8ae-1e51-4f7a-8adb-3dcee8ab180f tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] [instance: 4a2fe4f6-f020-4fdc-bb72-ffe298b56627] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:34:08.761169 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-38e0d8ae-1e51-4f7a-8adb-3dcee8ab180f tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:08.762201 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-38e0d8ae-1e51-4f7a-8adb-3dcee8ab180f tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:08.765683 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-38e0d8ae-1e51-4f7a-8adb-3dcee8ab180f tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:08.767317 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-38e0d8ae-1e51-4f7a-8adb-3dcee8ab180f tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:08.978511 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-38e0d8ae-1e51-4f7a-8adb-3dcee8ab180f tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47575a76d62b4a109fda03f4bf016fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c4f4baaf8f4a258171bf97abdc8905', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:34:08.989017 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-38e0d8ae-1e51-4f7a-8adb-3dcee8ab180f tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] 10.222.0.65 "GET /compute/v2.1/servers/4a2fe4f6-f020-4fdc-bb72-ffe298b56627" status: 200 len: 1313 microversion: 2.1 time: 0.246694 May 19 21:34:08.990148 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 115/239] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:34:08 2022] GET /compute/v2.1/servers/4a2fe4f6-f020-4fdc-bb72-ffe298b56627 => generated 1313 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:34:09.160611 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-95b68983-f5f2-4114-ad12-65ba8187ff50 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Action: 'create', calling method: .version_select at 0x7fe36802caf0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-2053369052", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL5cDHlfcrL5LgqsZVIGlhw6fPPck4IXd19OzCNsclKPFgKV0ym0s6chdgogwyIaW93LS00kAYZhVggAvggwI5wwDijATvCor0/riwfstSnnXCCRih2t+/x6J8lNeES2hA=="}} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:34:09.195067 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.quota [None req-95b68983-f5f2-4114-ad12-65ba8187ff50 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Getting quotas for project 4951b93f86e1485692a4aae7b9ece8f6. Resources: {'key_pairs'} {{(pid=124350) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 21:34:09.203617 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.quota [None req-95b68983-f5f2-4114-ad12-65ba8187ff50 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Getting quotas for user 0a58f82117ab437cab5607c204c86547 and project 4951b93f86e1485692a4aae7b9ece8f6. Resources: {'key_pairs'} {{(pid=124350) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 21:34:09.237461 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-4c1628cf-d35d-49c7-a3ab-1c42a60d5f09 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:34:09.238467 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-4c1628cf-d35d-49c7-a3ab-1c42a60d5f09 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: a18b9269-6ed1-4af1-a0da-8260f38fbf39] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:34:09.245254 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-4c1628cf-d35d-49c7-a3ab-1c42a60d5f09 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:09.245686 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-4c1628cf-d35d-49c7-a3ab-1c42a60d5f09 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:09.246731 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-4c1628cf-d35d-49c7-a3ab-1c42a60d5f09 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:09.247110 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-4c1628cf-d35d-49c7-a3ab-1c42a60d5f09 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:09.269537 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-95b68983-f5f2-4114-ad12-65ba8187ff50 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.379829 May 19 21:34:09.287521 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 125/240] 10.222.0.65 () {60 vars in 1158 bytes} [Thu May 19 21:34:08 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 21:34:09.446734 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-4c1628cf-d35d-49c7-a3ab-1c42a60d5f09 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1589968f375946a38e82ec484afc837f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c62c1f3c54f568abdac37360ab457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:34:09.459255 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-4c1628cf-d35d-49c7-a3ab-1c42a60d5f09 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "GET /compute/v2.1/servers/a18b9269-6ed1-4af1-a0da-8260f38fbf39" status: 200 len: 1523 microversion: 2.1 time: 0.232184 May 19 21:34:09.460383 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 116/241] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:34:09 2022] GET /compute/v2.1/servers/a18b9269-6ed1-4af1-a0da-8260f38fbf39 => generated 1523 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 21:34:10.012900 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-35ba8bd9-2fa1-4fee-a5d6-0fc295dba2a3 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:34:10.012900 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-35ba8bd9-2fa1-4fee-a5d6-0fc295dba2a3 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] [instance: 4a2fe4f6-f020-4fdc-bb72-ffe298b56627] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:34:10.044266 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:34:10.049230 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-35ba8bd9-2fa1-4fee-a5d6-0fc295dba2a3 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:10.050260 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-35ba8bd9-2fa1-4fee-a5d6-0fc295dba2a3 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:10.052234 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-35ba8bd9-2fa1-4fee-a5d6-0fc295dba2a3 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:10.053538 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-35ba8bd9-2fa1-4fee-a5d6-0fc295dba2a3 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:10.305805 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-35ba8bd9-2fa1-4fee-a5d6-0fc295dba2a3 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47575a76d62b4a109fda03f4bf016fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c4f4baaf8f4a258171bf97abdc8905', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:34:10.320105 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-35ba8bd9-2fa1-4fee-a5d6-0fc295dba2a3 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] 10.222.0.65 "GET /compute/v2.1/servers/4a2fe4f6-f020-4fdc-bb72-ffe298b56627" status: 200 len: 1313 microversion: 2.1 time: 0.314667 May 19 21:34:10.321829 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 126/242] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:34:10 2022] GET /compute/v2.1/servers/4a2fe4f6-f020-4fdc-bb72-ffe298b56627 => generated 1313 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:34:10.480696 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-cead360a-6dab-46e2-8da5-5091e50e5164 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:34:10.482617 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-cead360a-6dab-46e2-8da5-5091e50e5164 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: a18b9269-6ed1-4af1-a0da-8260f38fbf39] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:34:10.493773 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-cead360a-6dab-46e2-8da5-5091e50e5164 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:10.494674 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-cead360a-6dab-46e2-8da5-5091e50e5164 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:10.496208 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-cead360a-6dab-46e2-8da5-5091e50e5164 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:10.497114 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-cead360a-6dab-46e2-8da5-5091e50e5164 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:10.808625 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-cead360a-6dab-46e2-8da5-5091e50e5164 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1589968f375946a38e82ec484afc837f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c62c1f3c54f568abdac37360ab457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:34:10.817725 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-cead360a-6dab-46e2-8da5-5091e50e5164 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "GET /compute/v2.1/servers/a18b9269-6ed1-4af1-a0da-8260f38fbf39" status: 200 len: 1523 microversion: 2.1 time: 0.342165 May 19 21:34:10.819112 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 117/243] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:34:10 2022] GET /compute/v2.1/servers/a18b9269-6ed1-4af1-a0da-8260f38fbf39 => generated 1523 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:34:11.350116 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-2927b2f2-081e-4d9b-84d5-6e08fa3df447 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:34:11.351086 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-2927b2f2-081e-4d9b-84d5-6e08fa3df447 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] [instance: 4a2fe4f6-f020-4fdc-bb72-ffe298b56627] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:34:11.367016 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2927b2f2-081e-4d9b-84d5-6e08fa3df447 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:11.367881 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2927b2f2-081e-4d9b-84d5-6e08fa3df447 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:11.369984 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2927b2f2-081e-4d9b-84d5-6e08fa3df447 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:11.372048 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2927b2f2-081e-4d9b-84d5-6e08fa3df447 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:11.677989 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-2927b2f2-081e-4d9b-84d5-6e08fa3df447 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47575a76d62b4a109fda03f4bf016fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c4f4baaf8f4a258171bf97abdc8905', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:34:11.693218 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-2927b2f2-081e-4d9b-84d5-6e08fa3df447 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] 10.222.0.65 "GET /compute/v2.1/servers/4a2fe4f6-f020-4fdc-bb72-ffe298b56627" status: 200 len: 1313 microversion: 2.1 time: 0.345032 May 19 21:34:11.694705 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 127/244] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:34:11 2022] GET /compute/v2.1/servers/4a2fe4f6-f020-4fdc-bb72-ffe298b56627 => generated 1313 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:34:11.851282 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-18e038f2-cb38-4166-9731-8d3d687565b1 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:34:11.868762 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-18e038f2-cb38-4166-9731-8d3d687565b1 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: a18b9269-6ed1-4af1-a0da-8260f38fbf39] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:34:11.880459 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-18e038f2-cb38-4166-9731-8d3d687565b1 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:11.881289 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-18e038f2-cb38-4166-9731-8d3d687565b1 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:11.882487 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-18e038f2-cb38-4166-9731-8d3d687565b1 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:11.883146 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-18e038f2-cb38-4166-9731-8d3d687565b1 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:12.044444 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-18e038f2-cb38-4166-9731-8d3d687565b1 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1589968f375946a38e82ec484afc837f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c62c1f3c54f568abdac37360ab457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:34:12.052887 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-18e038f2-cb38-4166-9731-8d3d687565b1 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "GET /compute/v2.1/servers/a18b9269-6ed1-4af1-a0da-8260f38fbf39" status: 200 len: 1523 microversion: 2.1 time: 0.209529 May 19 21:34:12.053658 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 118/245] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:34:11 2022] GET /compute/v2.1/servers/a18b9269-6ed1-4af1-a0da-8260f38fbf39 => generated 1523 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 21:34:12.721560 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-0c8b6f1e-71e8-4ce1-b7e7-475f6a1f10b8 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:34:12.722326 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-0c8b6f1e-71e8-4ce1-b7e7-475f6a1f10b8 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] [instance: 4a2fe4f6-f020-4fdc-bb72-ffe298b56627] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:34:12.730181 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0c8b6f1e-71e8-4ce1-b7e7-475f6a1f10b8 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:12.730706 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0c8b6f1e-71e8-4ce1-b7e7-475f6a1f10b8 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:12.731516 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0c8b6f1e-71e8-4ce1-b7e7-475f6a1f10b8 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:12.731961 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0c8b6f1e-71e8-4ce1-b7e7-475f6a1f10b8 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:12.926207 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-0c8b6f1e-71e8-4ce1-b7e7-475f6a1f10b8 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47575a76d62b4a109fda03f4bf016fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c4f4baaf8f4a258171bf97abdc8905', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:34:12.935617 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-0c8b6f1e-71e8-4ce1-b7e7-475f6a1f10b8 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] 10.222.0.65 "GET /compute/v2.1/servers/4a2fe4f6-f020-4fdc-bb72-ffe298b56627" status: 200 len: 1313 microversion: 2.1 time: 0.218785 May 19 21:34:12.936212 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 128/246] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:34:12 2022] GET /compute/v2.1/servers/4a2fe4f6-f020-4fdc-bb72-ffe298b56627 => generated 1313 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:34:13.081880 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-19f982ed-1b9e-42ca-8f43-fa14e8c37f16 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:34:13.082942 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-19f982ed-1b9e-42ca-8f43-fa14e8c37f16 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: a18b9269-6ed1-4af1-a0da-8260f38fbf39] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:34:13.090445 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-19f982ed-1b9e-42ca-8f43-fa14e8c37f16 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:13.090841 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-19f982ed-1b9e-42ca-8f43-fa14e8c37f16 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:13.091637 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-19f982ed-1b9e-42ca-8f43-fa14e8c37f16 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:13.092073 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-19f982ed-1b9e-42ca-8f43-fa14e8c37f16 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:13.302958 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-19f982ed-1b9e-42ca-8f43-fa14e8c37f16 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1589968f375946a38e82ec484afc837f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c62c1f3c54f568abdac37360ab457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:34:13.312683 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-19f982ed-1b9e-42ca-8f43-fa14e8c37f16 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "GET /compute/v2.1/servers/a18b9269-6ed1-4af1-a0da-8260f38fbf39" status: 200 len: 1523 microversion: 2.1 time: 0.237284 May 19 21:34:13.313413 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 119/247] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:34:13 2022] GET /compute/v2.1/servers/a18b9269-6ed1-4af1-a0da-8260f38fbf39 => generated 1523 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:34:13.958661 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-7204b758-8b40-4312-afd3-de78ea1e97ec tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:34:13.960290 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-7204b758-8b40-4312-afd3-de78ea1e97ec tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] [instance: 4a2fe4f6-f020-4fdc-bb72-ffe298b56627] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:34:13.973183 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7204b758-8b40-4312-afd3-de78ea1e97ec tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:13.973782 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7204b758-8b40-4312-afd3-de78ea1e97ec tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:13.975041 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7204b758-8b40-4312-afd3-de78ea1e97ec tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:13.976110 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7204b758-8b40-4312-afd3-de78ea1e97ec tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:14.336591 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-1433d77d-aa25-48bf-ae50-e361c58271ab tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:34:14.337569 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-1433d77d-aa25-48bf-ae50-e361c58271ab tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: a18b9269-6ed1-4af1-a0da-8260f38fbf39] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:34:14.389922 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1433d77d-aa25-48bf-ae50-e361c58271ab tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:14.390902 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1433d77d-aa25-48bf-ae50-e361c58271ab tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:14.408727 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1433d77d-aa25-48bf-ae50-e361c58271ab tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:14.409489 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1433d77d-aa25-48bf-ae50-e361c58271ab tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:14.623578 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-7204b758-8b40-4312-afd3-de78ea1e97ec tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47575a76d62b4a109fda03f4bf016fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c4f4baaf8f4a258171bf97abdc8905', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:34:14.642272 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-7204b758-8b40-4312-afd3-de78ea1e97ec tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] 10.222.0.65 "GET /compute/v2.1/servers/4a2fe4f6-f020-4fdc-bb72-ffe298b56627" status: 200 len: 1313 microversion: 2.1 time: 0.691926 May 19 21:34:14.643753 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 129/248] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:34:13 2022] GET /compute/v2.1/servers/4a2fe4f6-f020-4fdc-bb72-ffe298b56627 => generated 1313 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:34:14.864306 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-1433d77d-aa25-48bf-ae50-e361c58271ab tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1589968f375946a38e82ec484afc837f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c62c1f3c54f568abdac37360ab457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:34:14.868597 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_cell1:SELECT=100 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:34:14.881944 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-1433d77d-aa25-48bf-ae50-e361c58271ab tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "GET /compute/v2.1/servers/a18b9269-6ed1-4af1-a0da-8260f38fbf39" status: 200 len: 1523 microversion: 2.1 time: 0.553365 May 19 21:34:14.883554 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 120/249] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:34:14 2022] GET /compute/v2.1/servers/a18b9269-6ed1-4af1-a0da-8260f38fbf39 => generated 1523 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:34:15.667682 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-e62b5c09-45ef-4ab1-a852-69e3cca8e845 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:34:15.668677 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-e62b5c09-45ef-4ab1-a852-69e3cca8e845 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] [instance: 4a2fe4f6-f020-4fdc-bb72-ffe298b56627] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:34:15.676679 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e62b5c09-45ef-4ab1-a852-69e3cca8e845 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:15.677093 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e62b5c09-45ef-4ab1-a852-69e3cca8e845 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:15.677899 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e62b5c09-45ef-4ab1-a852-69e3cca8e845 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:15.678331 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e62b5c09-45ef-4ab1-a852-69e3cca8e845 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:15.833075 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-e62b5c09-45ef-4ab1-a852-69e3cca8e845 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47575a76d62b4a109fda03f4bf016fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c4f4baaf8f4a258171bf97abdc8905', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:34:15.841122 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-e62b5c09-45ef-4ab1-a852-69e3cca8e845 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] 10.222.0.65 "GET /compute/v2.1/servers/4a2fe4f6-f020-4fdc-bb72-ffe298b56627" status: 200 len: 1313 microversion: 2.1 time: 0.177644 May 19 21:34:15.841710 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 130/250] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:34:15 2022] GET /compute/v2.1/servers/4a2fe4f6-f020-4fdc-bb72-ffe298b56627 => generated 1313 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 21:34:15.901558 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-302c1315-eb89-4f00-a889-3863f8eb2ed7 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:34:15.902219 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-302c1315-eb89-4f00-a889-3863f8eb2ed7 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: a18b9269-6ed1-4af1-a0da-8260f38fbf39] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:34:15.909253 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-302c1315-eb89-4f00-a889-3863f8eb2ed7 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:15.909696 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-302c1315-eb89-4f00-a889-3863f8eb2ed7 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:15.910529 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-302c1315-eb89-4f00-a889-3863f8eb2ed7 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:15.910964 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-302c1315-eb89-4f00-a889-3863f8eb2ed7 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:16.123542 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-302c1315-eb89-4f00-a889-3863f8eb2ed7 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1589968f375946a38e82ec484afc837f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c62c1f3c54f568abdac37360ab457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:34:16.133123 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-302c1315-eb89-4f00-a889-3863f8eb2ed7 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "GET /compute/v2.1/servers/a18b9269-6ed1-4af1-a0da-8260f38fbf39" status: 200 len: 1523 microversion: 2.1 time: 0.235445 May 19 21:34:16.133747 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 121/251] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:34:15 2022] GET /compute/v2.1/servers/a18b9269-6ed1-4af1-a0da-8260f38fbf39 => generated 1523 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:34:16.864291 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-f559640a-9dc9-4c07-9266-7e28be202763 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:34:16.864898 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-f559640a-9dc9-4c07-9266-7e28be202763 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] [instance: 4a2fe4f6-f020-4fdc-bb72-ffe298b56627] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:34:16.875669 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f559640a-9dc9-4c07-9266-7e28be202763 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:16.876429 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f559640a-9dc9-4c07-9266-7e28be202763 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:16.877716 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f559640a-9dc9-4c07-9266-7e28be202763 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:16.878505 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f559640a-9dc9-4c07-9266-7e28be202763 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:17.070370 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-f559640a-9dc9-4c07-9266-7e28be202763 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47575a76d62b4a109fda03f4bf016fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c4f4baaf8f4a258171bf97abdc8905', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:34:17.078818 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-f559640a-9dc9-4c07-9266-7e28be202763 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] 10.222.0.65 "GET /compute/v2.1/servers/4a2fe4f6-f020-4fdc-bb72-ffe298b56627" status: 200 len: 1313 microversion: 2.1 time: 0.218173 May 19 21:34:17.079464 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 131/252] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:34:16 2022] GET /compute/v2.1/servers/4a2fe4f6-f020-4fdc-bb72-ffe298b56627 => generated 1313 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 21:34:17.150832 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-d2c36fee-f987-45eb-8d73-41078c4d51b9 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:34:17.151694 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-d2c36fee-f987-45eb-8d73-41078c4d51b9 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: a18b9269-6ed1-4af1-a0da-8260f38fbf39] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:34:17.158437 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-d2c36fee-f987-45eb-8d73-41078c4d51b9 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:17.158978 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-d2c36fee-f987-45eb-8d73-41078c4d51b9 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:17.159830 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-d2c36fee-f987-45eb-8d73-41078c4d51b9 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:17.160264 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-d2c36fee-f987-45eb-8d73-41078c4d51b9 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:17.321468 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-d2c36fee-f987-45eb-8d73-41078c4d51b9 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1589968f375946a38e82ec484afc837f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c62c1f3c54f568abdac37360ab457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:34:17.330002 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-d2c36fee-f987-45eb-8d73-41078c4d51b9 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "GET /compute/v2.1/servers/a18b9269-6ed1-4af1-a0da-8260f38fbf39" status: 200 len: 1523 microversion: 2.1 time: 0.183344 May 19 21:34:17.330630 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 122/253] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:34:17 2022] GET /compute/v2.1/servers/a18b9269-6ed1-4af1-a0da-8260f38fbf39 => generated 1523 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:34:18.101972 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-68fdb5c7-25fa-4c8b-b620-d2be583c615d tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:34:18.103281 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-68fdb5c7-25fa-4c8b-b620-d2be583c615d tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] [instance: 4a2fe4f6-f020-4fdc-bb72-ffe298b56627] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:34:18.114690 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-68fdb5c7-25fa-4c8b-b620-d2be583c615d tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:18.115714 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-68fdb5c7-25fa-4c8b-b620-d2be583c615d tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:18.117480 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-68fdb5c7-25fa-4c8b-b620-d2be583c615d tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:18.118569 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-68fdb5c7-25fa-4c8b-b620-d2be583c615d tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:18.307001 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-68fdb5c7-25fa-4c8b-b620-d2be583c615d tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47575a76d62b4a109fda03f4bf016fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c4f4baaf8f4a258171bf97abdc8905', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:34:18.322401 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-68fdb5c7-25fa-4c8b-b620-d2be583c615d tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] 10.222.0.65 "GET /compute/v2.1/servers/4a2fe4f6-f020-4fdc-bb72-ffe298b56627" status: 200 len: 1313 microversion: 2.1 time: 0.228314 May 19 21:34:18.323397 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 132/254] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:34:18 2022] GET /compute/v2.1/servers/4a2fe4f6-f020-4fdc-bb72-ffe298b56627 => generated 1313 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 21:34:18.348720 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-53c22993-b33d-4e83-ae86-af489851eaad tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:34:18.349360 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-53c22993-b33d-4e83-ae86-af489851eaad tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: a18b9269-6ed1-4af1-a0da-8260f38fbf39] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:34:18.356796 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-53c22993-b33d-4e83-ae86-af489851eaad tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:18.357186 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-53c22993-b33d-4e83-ae86-af489851eaad tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:18.358018 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-53c22993-b33d-4e83-ae86-af489851eaad tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:18.358646 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-53c22993-b33d-4e83-ae86-af489851eaad tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:18.536701 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-53c22993-b33d-4e83-ae86-af489851eaad tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1589968f375946a38e82ec484afc837f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c62c1f3c54f568abdac37360ab457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:34:18.545415 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-53c22993-b33d-4e83-ae86-af489851eaad tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "GET /compute/v2.1/servers/a18b9269-6ed1-4af1-a0da-8260f38fbf39" status: 200 len: 1523 microversion: 2.1 time: 0.200627 May 19 21:34:18.546012 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 123/255] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:34:18 2022] GET /compute/v2.1/servers/a18b9269-6ed1-4af1-a0da-8260f38fbf39 => generated 1523 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:34:19.340164 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-62236881-576f-4c50-aab6-bd672cd7dca7 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:34:19.340854 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-62236881-576f-4c50-aab6-bd672cd7dca7 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] [instance: 4a2fe4f6-f020-4fdc-bb72-ffe298b56627] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:34:19.344142 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell0:SELECT=4 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:34:19.350861 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-62236881-576f-4c50-aab6-bd672cd7dca7 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:19.351286 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-62236881-576f-4c50-aab6-bd672cd7dca7 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:19.352106 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-62236881-576f-4c50-aab6-bd672cd7dca7 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:19.352534 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-62236881-576f-4c50-aab6-bd672cd7dca7 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:19.505693 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-62236881-576f-4c50-aab6-bd672cd7dca7 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47575a76d62b4a109fda03f4bf016fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c4f4baaf8f4a258171bf97abdc8905', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:34:19.518475 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-62236881-576f-4c50-aab6-bd672cd7dca7 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] 10.222.0.65 "GET /compute/v2.1/servers/4a2fe4f6-f020-4fdc-bb72-ffe298b56627" status: 200 len: 1313 microversion: 2.1 time: 0.181916 May 19 21:34:19.519579 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 133/256] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:34:19 2022] GET /compute/v2.1/servers/4a2fe4f6-f020-4fdc-bb72-ffe298b56627 => generated 1313 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:34:19.564730 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-bc7e9706-28f3-4d5d-b336-d483949a2ffe tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:34:19.565738 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-bc7e9706-28f3-4d5d-b336-d483949a2ffe tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: a18b9269-6ed1-4af1-a0da-8260f38fbf39] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:34:19.568091 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_api:SELECT=50 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:34:19.577395 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-bc7e9706-28f3-4d5d-b336-d483949a2ffe tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:19.578277 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-bc7e9706-28f3-4d5d-b336-d483949a2ffe tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:19.579602 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-bc7e9706-28f3-4d5d-b336-d483949a2ffe tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:19.580613 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-bc7e9706-28f3-4d5d-b336-d483949a2ffe tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:19.761454 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-bc7e9706-28f3-4d5d-b336-d483949a2ffe tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1589968f375946a38e82ec484afc837f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c62c1f3c54f568abdac37360ab457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:34:19.770594 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-bc7e9706-28f3-4d5d-b336-d483949a2ffe tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "GET /compute/v2.1/servers/a18b9269-6ed1-4af1-a0da-8260f38fbf39" status: 200 len: 1523 microversion: 2.1 time: 0.210999 May 19 21:34:19.771161 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 124/257] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:34:19 2022] GET /compute/v2.1/servers/a18b9269-6ed1-4af1-a0da-8260f38fbf39 => generated 1523 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:34:20.542380 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-958da6d1-5317-4755-a06e-8b0254330225 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:34:20.543487 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-958da6d1-5317-4755-a06e-8b0254330225 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] [instance: 4a2fe4f6-f020-4fdc-bb72-ffe298b56627] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:34:20.554334 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-958da6d1-5317-4755-a06e-8b0254330225 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:20.555024 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-958da6d1-5317-4755-a06e-8b0254330225 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:20.556205 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-958da6d1-5317-4755-a06e-8b0254330225 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:20.556745 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-958da6d1-5317-4755-a06e-8b0254330225 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:20.591096 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:34:20.784467 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-958da6d1-5317-4755-a06e-8b0254330225 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47575a76d62b4a109fda03f4bf016fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c4f4baaf8f4a258171bf97abdc8905', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:34:20.789911 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-e1d5f08e-b6d5-47cb-8cbe-be7cd21761ff tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:34:20.791092 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-e1d5f08e-b6d5-47cb-8cbe-be7cd21761ff tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: a18b9269-6ed1-4af1-a0da-8260f38fbf39] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:34:20.797177 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-958da6d1-5317-4755-a06e-8b0254330225 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] 10.222.0.65 "GET /compute/v2.1/servers/4a2fe4f6-f020-4fdc-bb72-ffe298b56627" status: 200 len: 1313 microversion: 2.1 time: 0.258967 May 19 21:34:20.798151 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 134/258] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:34:20 2022] GET /compute/v2.1/servers/4a2fe4f6-f020-4fdc-bb72-ffe298b56627 => generated 1313 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:34:20.800131 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e1d5f08e-b6d5-47cb-8cbe-be7cd21761ff tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:20.800691 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e1d5f08e-b6d5-47cb-8cbe-be7cd21761ff tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:20.802046 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e1d5f08e-b6d5-47cb-8cbe-be7cd21761ff tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:20.802812 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e1d5f08e-b6d5-47cb-8cbe-be7cd21761ff tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:20.977405 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-e1d5f08e-b6d5-47cb-8cbe-be7cd21761ff tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1589968f375946a38e82ec484afc837f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c62c1f3c54f568abdac37360ab457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:34:20.988000 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-e1d5f08e-b6d5-47cb-8cbe-be7cd21761ff tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "GET /compute/v2.1/servers/a18b9269-6ed1-4af1-a0da-8260f38fbf39" status: 200 len: 1523 microversion: 2.1 time: 0.203010 May 19 21:34:20.988606 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 125/259] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:34:20 2022] GET /compute/v2.1/servers/a18b9269-6ed1-4af1-a0da-8260f38fbf39 => generated 1523 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 21:34:21.816489 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-24fb89d6-f6b9-4aa0-b09b-dcd1c1a6b4c0 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:34:21.817368 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-24fb89d6-f6b9-4aa0-b09b-dcd1c1a6b4c0 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] [instance: 4a2fe4f6-f020-4fdc-bb72-ffe298b56627] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:34:21.824726 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-24fb89d6-f6b9-4aa0-b09b-dcd1c1a6b4c0 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:21.825199 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-24fb89d6-f6b9-4aa0-b09b-dcd1c1a6b4c0 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:21.826020 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-24fb89d6-f6b9-4aa0-b09b-dcd1c1a6b4c0 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:21.826496 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-24fb89d6-f6b9-4aa0-b09b-dcd1c1a6b4c0 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:21.995440 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-24fb89d6-f6b9-4aa0-b09b-dcd1c1a6b4c0 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47575a76d62b4a109fda03f4bf016fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c4f4baaf8f4a258171bf97abdc8905', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:34:22.005584 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-24fb89d6-f6b9-4aa0-b09b-dcd1c1a6b4c0 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] 10.222.0.65 "GET /compute/v2.1/servers/4a2fe4f6-f020-4fdc-bb72-ffe298b56627" status: 200 len: 1313 microversion: 2.1 time: 0.192825 May 19 21:34:22.006705 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 135/260] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:34:21 2022] GET /compute/v2.1/servers/4a2fe4f6-f020-4fdc-bb72-ffe298b56627 => generated 1313 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:34:22.009689 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-af3a4b45-371c-48a6-a84e-e9620cfb6c65 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:34:22.010844 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-af3a4b45-371c-48a6-a84e-e9620cfb6c65 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: a18b9269-6ed1-4af1-a0da-8260f38fbf39] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:34:22.022202 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-af3a4b45-371c-48a6-a84e-e9620cfb6c65 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:22.023010 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-af3a4b45-371c-48a6-a84e-e9620cfb6c65 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:22.024376 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-af3a4b45-371c-48a6-a84e-e9620cfb6c65 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:22.025138 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-af3a4b45-371c-48a6-a84e-e9620cfb6c65 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:22.195411 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-af3a4b45-371c-48a6-a84e-e9620cfb6c65 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1589968f375946a38e82ec484afc837f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c62c1f3c54f568abdac37360ab457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:34:22.206092 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-af3a4b45-371c-48a6-a84e-e9620cfb6c65 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "GET /compute/v2.1/servers/a18b9269-6ed1-4af1-a0da-8260f38fbf39" status: 200 len: 1523 microversion: 2.1 time: 0.203744 May 19 21:34:22.207010 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 126/261] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:34:22 2022] GET /compute/v2.1/servers/a18b9269-6ed1-4af1-a0da-8260f38fbf39 => generated 1523 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:34:23.024026 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-4290db49-adcd-410e-8060-6057806de4e5 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:34:23.024624 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-4290db49-adcd-410e-8060-6057806de4e5 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] [instance: 4a2fe4f6-f020-4fdc-bb72-ffe298b56627] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:34:23.032246 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4290db49-adcd-410e-8060-6057806de4e5 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:23.032698 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4290db49-adcd-410e-8060-6057806de4e5 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:23.033486 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4290db49-adcd-410e-8060-6057806de4e5 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:23.033914 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4290db49-adcd-410e-8060-6057806de4e5 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:23.229934 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-6c31fd8d-ba17-4e9a-89e7-0a519aca7dde tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:34:23.230864 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-6c31fd8d-ba17-4e9a-89e7-0a519aca7dde tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: a18b9269-6ed1-4af1-a0da-8260f38fbf39] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:34:23.239084 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-6c31fd8d-ba17-4e9a-89e7-0a519aca7dde tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:23.239650 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-6c31fd8d-ba17-4e9a-89e7-0a519aca7dde tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:23.240540 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-6c31fd8d-ba17-4e9a-89e7-0a519aca7dde tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:23.241152 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-6c31fd8d-ba17-4e9a-89e7-0a519aca7dde tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:23.256242 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-4290db49-adcd-410e-8060-6057806de4e5 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47575a76d62b4a109fda03f4bf016fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c4f4baaf8f4a258171bf97abdc8905', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:34:23.268960 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-4290db49-adcd-410e-8060-6057806de4e5 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] 10.222.0.65 "GET /compute/v2.1/servers/4a2fe4f6-f020-4fdc-bb72-ffe298b56627" status: 200 len: 1313 microversion: 2.1 time: 0.248713 May 19 21:34:23.269906 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 136/262] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:34:23 2022] GET /compute/v2.1/servers/4a2fe4f6-f020-4fdc-bb72-ffe298b56627 => generated 1313 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:34:23.450148 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-6c31fd8d-ba17-4e9a-89e7-0a519aca7dde tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1589968f375946a38e82ec484afc837f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c62c1f3c54f568abdac37360ab457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:34:23.458634 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-6c31fd8d-ba17-4e9a-89e7-0a519aca7dde tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "GET /compute/v2.1/servers/a18b9269-6ed1-4af1-a0da-8260f38fbf39" status: 200 len: 1523 microversion: 2.1 time: 0.237421 May 19 21:34:23.459223 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 127/263] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:34:23 2022] GET /compute/v2.1/servers/a18b9269-6ed1-4af1-a0da-8260f38fbf39 => generated 1523 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:34:24.290812 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-8543ef0e-d992-485f-9bd0-c8e72e704309 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:34:24.291762 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-8543ef0e-d992-485f-9bd0-c8e72e704309 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] [instance: 4a2fe4f6-f020-4fdc-bb72-ffe298b56627] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:34:24.300379 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8543ef0e-d992-485f-9bd0-c8e72e704309 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:24.300854 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8543ef0e-d992-485f-9bd0-c8e72e704309 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:24.301594 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8543ef0e-d992-485f-9bd0-c8e72e704309 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:24.302047 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8543ef0e-d992-485f-9bd0-c8e72e704309 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:24.467605 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-8543ef0e-d992-485f-9bd0-c8e72e704309 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47575a76d62b4a109fda03f4bf016fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c4f4baaf8f4a258171bf97abdc8905', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:34:24.483091 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-8543ef0e-d992-485f-9bd0-c8e72e704309 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] 10.222.0.65 "GET /compute/v2.1/servers/4a2fe4f6-f020-4fdc-bb72-ffe298b56627" status: 200 len: 1313 microversion: 2.1 time: 0.197186 May 19 21:34:24.485424 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 137/264] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:34:24 2022] GET /compute/v2.1/servers/4a2fe4f6-f020-4fdc-bb72-ffe298b56627 => generated 1313 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:34:24.498336 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-6dd5e051-6812-438f-9dc9-8271d4d7a239 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:34:24.499247 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-6dd5e051-6812-438f-9dc9-8271d4d7a239 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: a18b9269-6ed1-4af1-a0da-8260f38fbf39] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:34:24.506749 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-6dd5e051-6812-438f-9dc9-8271d4d7a239 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:24.507187 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-6dd5e051-6812-438f-9dc9-8271d4d7a239 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:24.507964 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-6dd5e051-6812-438f-9dc9-8271d4d7a239 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:24.508383 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-6dd5e051-6812-438f-9dc9-8271d4d7a239 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:24.540850 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [req-7bff5534-a66f-4fa5-a012-8bdba2757d4d req-8e5de68d-ebba-407a-aae5-17138c194d45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a2fe4f6-f020-4fdc-bb72-ffe298b56627", "name": "network-vif-plugged", "status": "completed", "tag": "abeca8c2-0922-427b-bde2-2a81f568efa5"}]} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:34:24.553605 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-7bff5534-a66f-4fa5-a012-8bdba2757d4d req-8e5de68d-ebba-407a-aae5-17138c194d45 service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:24.554496 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-7bff5534-a66f-4fa5-a012-8bdba2757d4d req-8e5de68d-ebba-407a-aae5-17138c194d45 service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:24.572542 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.compute.server_external_events [req-7bff5534-a66f-4fa5-a012-8bdba2757d4d req-8e5de68d-ebba-407a-aae5-17138c194d45 service nova] Creating event network-vif-plugged:abeca8c2-0922-427b-bde2-2a81f568efa5 for instance 4a2fe4f6-f020-4fdc-bb72-ffe298b56627 on hv-cinder-83563 May 19 21:34:24.578935 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [req-7bff5534-a66f-4fa5-a012-8bdba2757d4d req-8e5de68d-ebba-407a-aae5-17138c194d45 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048574 May 19 21:34:24.580946 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 138/265] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 21:34:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 21:34:24.718741 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-6dd5e051-6812-438f-9dc9-8271d4d7a239 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1589968f375946a38e82ec484afc837f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c62c1f3c54f568abdac37360ab457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:34:24.731489 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-6dd5e051-6812-438f-9dc9-8271d4d7a239 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "GET /compute/v2.1/servers/a18b9269-6ed1-4af1-a0da-8260f38fbf39" status: 200 len: 1523 microversion: 2.1 time: 0.248090 May 19 21:34:24.732784 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 128/266] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:34:24 2022] GET /compute/v2.1/servers/a18b9269-6ed1-4af1-a0da-8260f38fbf39 => generated 1523 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:34:25.502816 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-b0d01999-4189-4ccc-a77b-8ed4d79aae6d tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:34:25.503676 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-b0d01999-4189-4ccc-a77b-8ed4d79aae6d tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] [instance: 4a2fe4f6-f020-4fdc-bb72-ffe298b56627] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:34:25.510232 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b0d01999-4189-4ccc-a77b-8ed4d79aae6d tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:25.510701 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b0d01999-4189-4ccc-a77b-8ed4d79aae6d tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:25.511476 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b0d01999-4189-4ccc-a77b-8ed4d79aae6d tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:25.511903 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b0d01999-4189-4ccc-a77b-8ed4d79aae6d tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:25.756682 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-5c2dffd1-12ee-4a24-9505-18ec884d934f tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:34:25.757572 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-5c2dffd1-12ee-4a24-9505-18ec884d934f tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: a18b9269-6ed1-4af1-a0da-8260f38fbf39] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:34:25.776363 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-5c2dffd1-12ee-4a24-9505-18ec884d934f tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:25.776903 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-5c2dffd1-12ee-4a24-9505-18ec884d934f tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:25.777746 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-5c2dffd1-12ee-4a24-9505-18ec884d934f tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:25.778189 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-5c2dffd1-12ee-4a24-9505-18ec884d934f tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:26.054792 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-b0d01999-4189-4ccc-a77b-8ed4d79aae6d tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47575a76d62b4a109fda03f4bf016fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c4f4baaf8f4a258171bf97abdc8905', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:34:26.064173 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-b0d01999-4189-4ccc-a77b-8ed4d79aae6d tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] 10.222.0.65 "GET /compute/v2.1/servers/4a2fe4f6-f020-4fdc-bb72-ffe298b56627" status: 200 len: 1313 microversion: 2.1 time: 0.566590 May 19 21:34:26.065809 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 139/267] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:34:25 2022] GET /compute/v2.1/servers/4a2fe4f6-f020-4fdc-bb72-ffe298b56627 => generated 1313 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:34:26.243569 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-5c2dffd1-12ee-4a24-9505-18ec884d934f tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1589968f375946a38e82ec484afc837f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c62c1f3c54f568abdac37360ab457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:34:26.252914 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-5c2dffd1-12ee-4a24-9505-18ec884d934f tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "GET /compute/v2.1/servers/a18b9269-6ed1-4af1-a0da-8260f38fbf39" status: 200 len: 1523 microversion: 2.1 time: 0.501039 May 19 21:34:26.253504 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 129/268] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:34:25 2022] GET /compute/v2.1/servers/a18b9269-6ed1-4af1-a0da-8260f38fbf39 => generated 1523 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 21:34:27.094053 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-b60e84b1-7f05-48be-8ffd-dc7c5b95ed57 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:34:27.095181 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-b60e84b1-7f05-48be-8ffd-dc7c5b95ed57 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] [instance: 4a2fe4f6-f020-4fdc-bb72-ffe298b56627] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:34:27.105627 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b60e84b1-7f05-48be-8ffd-dc7c5b95ed57 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:27.106361 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b60e84b1-7f05-48be-8ffd-dc7c5b95ed57 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:27.107650 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b60e84b1-7f05-48be-8ffd-dc7c5b95ed57 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:27.108330 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b60e84b1-7f05-48be-8ffd-dc7c5b95ed57 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:27.289085 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-2fd2ac44-edc2-4647-8661-96e1b19befda tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:34:27.290478 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-2fd2ac44-edc2-4647-8661-96e1b19befda tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: a18b9269-6ed1-4af1-a0da-8260f38fbf39] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:34:27.300386 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-2fd2ac44-edc2-4647-8661-96e1b19befda tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:27.301161 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-2fd2ac44-edc2-4647-8661-96e1b19befda tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:27.302715 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-2fd2ac44-edc2-4647-8661-96e1b19befda tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:27.303496 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-2fd2ac44-edc2-4647-8661-96e1b19befda tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:27.350737 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-b60e84b1-7f05-48be-8ffd-dc7c5b95ed57 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47575a76d62b4a109fda03f4bf016fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c4f4baaf8f4a258171bf97abdc8905', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:34:27.360409 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-b60e84b1-7f05-48be-8ffd-dc7c5b95ed57 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] 10.222.0.65 "GET /compute/v2.1/servers/4a2fe4f6-f020-4fdc-bb72-ffe298b56627" status: 200 len: 1313 microversion: 2.1 time: 0.274626 May 19 21:34:27.361583 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 140/269] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:34:27 2022] GET /compute/v2.1/servers/4a2fe4f6-f020-4fdc-bb72-ffe298b56627 => generated 1313 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:34:27.572840 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-2fd2ac44-edc2-4647-8661-96e1b19befda tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1589968f375946a38e82ec484afc837f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c62c1f3c54f568abdac37360ab457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:34:27.592511 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-2fd2ac44-edc2-4647-8661-96e1b19befda tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "GET /compute/v2.1/servers/a18b9269-6ed1-4af1-a0da-8260f38fbf39" status: 200 len: 1523 microversion: 2.1 time: 0.317996 May 19 21:34:27.593208 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 130/270] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:34:27 2022] GET /compute/v2.1/servers/a18b9269-6ed1-4af1-a0da-8260f38fbf39 => generated 1523 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 21:34:28.377765 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-e4202f9d-072c-464b-a449-8351561d96cd tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:34:28.378717 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-e4202f9d-072c-464b-a449-8351561d96cd tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] [instance: 4a2fe4f6-f020-4fdc-bb72-ffe298b56627] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:34:28.386080 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e4202f9d-072c-464b-a449-8351561d96cd tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:28.386538 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e4202f9d-072c-464b-a449-8351561d96cd tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:28.388432 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e4202f9d-072c-464b-a449-8351561d96cd tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:28.388971 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e4202f9d-072c-464b-a449-8351561d96cd tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:28.575778 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-e4202f9d-072c-464b-a449-8351561d96cd tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47575a76d62b4a109fda03f4bf016fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c4f4baaf8f4a258171bf97abdc8905', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:34:28.584903 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-e4202f9d-072c-464b-a449-8351561d96cd tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] 10.222.0.65 "GET /compute/v2.1/servers/4a2fe4f6-f020-4fdc-bb72-ffe298b56627" status: 200 len: 1496 microversion: 2.1 time: 0.211098 May 19 21:34:28.585515 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 141/271] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:34:28 2022] GET /compute/v2.1/servers/4a2fe4f6-f020-4fdc-bb72-ffe298b56627 => generated 1496 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:34:28.620678 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-c7063a8d-12ba-4eb5-9277-deaaaa51dfcf tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:34:28.621284 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-c7063a8d-12ba-4eb5-9277-deaaaa51dfcf tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: a18b9269-6ed1-4af1-a0da-8260f38fbf39] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:34:28.628564 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c7063a8d-12ba-4eb5-9277-deaaaa51dfcf tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:28.629030 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c7063a8d-12ba-4eb5-9277-deaaaa51dfcf tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:28.629982 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c7063a8d-12ba-4eb5-9277-deaaaa51dfcf tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:28.630559 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c7063a8d-12ba-4eb5-9277-deaaaa51dfcf tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:28.800651 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-c7063a8d-12ba-4eb5-9277-deaaaa51dfcf tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1589968f375946a38e82ec484afc837f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c62c1f3c54f568abdac37360ab457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:34:28.810903 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-c7063a8d-12ba-4eb5-9277-deaaaa51dfcf tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "GET /compute/v2.1/servers/a18b9269-6ed1-4af1-a0da-8260f38fbf39" status: 200 len: 1523 microversion: 2.1 time: 0.194200 May 19 21:34:28.811490 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 131/272] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:34:28 2022] GET /compute/v2.1/servers/a18b9269-6ed1-4af1-a0da-8260f38fbf39 => generated 1523 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:34:29.434513 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-16be5ed1-b8dc-4379-864b-9dae5ae4dae8 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:34:29.435381 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-16be5ed1-b8dc-4379-864b-9dae5ae4dae8 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] [instance: 4a2fe4f6-f020-4fdc-bb72-ffe298b56627] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:34:29.449274 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-16be5ed1-b8dc-4379-864b-9dae5ae4dae8 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:29.450080 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-16be5ed1-b8dc-4379-864b-9dae5ae4dae8 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:29.451519 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-16be5ed1-b8dc-4379-864b-9dae5ae4dae8 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:29.452353 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-16be5ed1-b8dc-4379-864b-9dae5ae4dae8 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:29.498903 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-16be5ed1-b8dc-4379-864b-9dae5ae4dae8 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] [instance: 4a2fe4f6-f020-4fdc-bb72-ffe298b56627] Going to try to terminate instance {{(pid=124350) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 21:34:29.629182 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-16be5ed1-b8dc-4379-864b-9dae5ae4dae8 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] 10.222.0.65 "DELETE /compute/v2.1/servers/4a2fe4f6-f020-4fdc-bb72-ffe298b56627" status: 204 len: 0 microversion: 2.1 time: 0.202047 May 19 21:34:29.629886 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 142/273] 10.222.0.65 () {58 vars in 1238 bytes} [Thu May 19 21:34:29 2022] DELETE /compute/v2.1/servers/4a2fe4f6-f020-4fdc-bb72-ffe298b56627 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 21:34:29.646665 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-6227866c-6029-4e2d-b52e-d759db07d9b0 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:34:29.647297 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-6227866c-6029-4e2d-b52e-d759db07d9b0 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] [instance: 4a2fe4f6-f020-4fdc-bb72-ffe298b56627] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:34:29.653744 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-6227866c-6029-4e2d-b52e-d759db07d9b0 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:29.654695 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-6227866c-6029-4e2d-b52e-d759db07d9b0 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:29.655784 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-6227866c-6029-4e2d-b52e-d759db07d9b0 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:29.656218 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-6227866c-6029-4e2d-b52e-d759db07d9b0 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:29.831170 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-22dbd1da-5612-4306-87b5-098e026d5bf3 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:34:29.832393 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-22dbd1da-5612-4306-87b5-098e026d5bf3 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: a18b9269-6ed1-4af1-a0da-8260f38fbf39] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:34:29.839662 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-22dbd1da-5612-4306-87b5-098e026d5bf3 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:29.840225 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-22dbd1da-5612-4306-87b5-098e026d5bf3 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:29.841197 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-22dbd1da-5612-4306-87b5-098e026d5bf3 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:29.842579 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-22dbd1da-5612-4306-87b5-098e026d5bf3 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:29.954414 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-6227866c-6029-4e2d-b52e-d759db07d9b0 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47575a76d62b4a109fda03f4bf016fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c4f4baaf8f4a258171bf97abdc8905', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:34:29.968707 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-6227866c-6029-4e2d-b52e-d759db07d9b0 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] 10.222.0.65 "GET /compute/v2.1/servers/4a2fe4f6-f020-4fdc-bb72-ffe298b56627" status: 200 len: 1502 microversion: 2.1 time: 0.327744 May 19 21:34:29.979009 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 132/274] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:34:29 2022] GET /compute/v2.1/servers/4a2fe4f6-f020-4fdc-bb72-ffe298b56627 => generated 1502 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 21:34:30.122917 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-22dbd1da-5612-4306-87b5-098e026d5bf3 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1589968f375946a38e82ec484afc837f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c62c1f3c54f568abdac37360ab457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:34:30.132349 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-22dbd1da-5612-4306-87b5-098e026d5bf3 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "GET /compute/v2.1/servers/a18b9269-6ed1-4af1-a0da-8260f38fbf39" status: 200 len: 1503 microversion: 2.1 time: 0.306456 May 19 21:34:30.132913 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 143/275] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:34:29 2022] GET /compute/v2.1/servers/a18b9269-6ed1-4af1-a0da-8260f38fbf39 => generated 1503 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 21:34:30.165528 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-08f1be3a-396e-48ba-a0da-eef9c9c6d531 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a750a2a2-6bba-4fe4-a833-eb8b1644fc3b"}} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:34:30.166906 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-08f1be3a-396e-48ba-a0da-eef9c9c6d531 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: a18b9269-6ed1-4af1-a0da-8260f38fbf39] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:34:30.179872 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-08f1be3a-396e-48ba-a0da-eef9c9c6d531 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:30.180354 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-08f1be3a-396e-48ba-a0da-eef9c9c6d531 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:30.181403 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-08f1be3a-396e-48ba-a0da-eef9c9c6d531 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:30.181929 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-08f1be3a-396e-48ba-a0da-eef9c9c6d531 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:30.229378 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.wsgi [None req-08f1be3a-396e-48ba-a0da-eef9c9c6d531 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] HTTP exception thrown: Cannot 'attach_volume' instance a18b9269-6ed1-4af1-a0da-8260f38fbf39 while it is in vm_state rescued May 19 21:34:30.232462 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-08f1be3a-396e-48ba-a0da-eef9c9c6d531 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Request method failure captured: May 19 21:34:30.232462 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: request: POST /compute/v2.1/servers/a18b9269-6ed1-4af1-a0da-8260f38fbf39/os-volume_attachments HTTP/1.1 May 19 21:34:30.232462 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Accept: application/json May 19 21:34:30.232462 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Accept-Encoding: identity May 19 21:34:30.232462 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Connection: close May 19 21:34:30.232462 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Content-Length: 74 May 19 21:34:30.232462 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Content-Type: application/json May 19 21:34:30.232462 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Host: 10.222.0.65 May 19 21:34:30.232462 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Openstack-System-Scope: None May 19 21:34:30.232462 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: User-Agent: python-urllib3/1.26.9 May 19 21:34:30.232462 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Auth-Token: gAAAAABihrdiO8WlYaDIi7If9wZxpwSGzpo12IIIWNH6BfJt71nk5vcpOYqFB3VPd06TTglmiGbN4sYDeZcKhy-4mKZalpEB_LLIlrgRhEAAwCx0bHylpvZxTT7OZ_q99On0cqILTOHkFkDE0bep6C1Ese4EHQeGGDI-xr78VggcJ9wPIAfjlIA May 19 21:34:30.232462 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Domain-Id: None May 19 21:34:30.232462 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Domain-Name: None May 19 21:34:30.232462 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Identity-Status: Confirmed May 19 21:34:30.232462 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Is-Admin-Project: True May 19 21:34:30.232462 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Project-Domain-Id: default May 19 21:34:30.232462 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Project-Domain-Name: Default May 19 21:34:30.232462 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Project-Id: 985c62c1f3c54f568abdac37360ab457 May 19 21:34:30.232462 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-338234618 May 19 21:34:30.232462 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Role: reader,member May 19 21:34:30.232462 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Roles: reader,member May 19 21:34:30.235203 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/985c62c1f3c54f568abdac37360ab457"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/985c62c1f3c54f568abdac37360ab457"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_985c62c1f3c54f568abdac37360ab457"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/985c62c1f3c54f568abdac37360ab457"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}] May 19 21:34:30.235203 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Tenant: tempest-ServerRescueNegativeTestJSON-338234618 May 19 21:34:30.235203 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Tenant-Id: 985c62c1f3c54f568abdac37360ab457 May 19 21:34:30.235203 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-338234618 May 19 21:34:30.235203 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-User: tempest-ServerRescueNegativeTestJSON-338234618-project May 19 21:34:30.235203 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-User-Domain-Id: default May 19 21:34:30.235203 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-User-Domain-Name: Default May 19 21:34:30.235203 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-User-Id: 1589968f375946a38e82ec484afc837f May 19 21:34:30.235203 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-User-Name: tempest-ServerRescueNegativeTestJSON-338234618-project May 19 21:34:30.235203 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: May 19 21:34:30.235203 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: {"volumeAttachment": {"volumeId": "a750a2a2-6bba-4fe4-a833-eb8b1644fc3b"}} May 19 21:34:30.235203 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: method: > May 19 21:34:30.236138 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: exception: Cannot 'attach_volume' instance a18b9269-6ed1-4af1-a0da-8260f38fbf39 while it is in vm_state rescued May 19 21:34:30.236138 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: action_args: {'server_id': 'a18b9269-6ed1-4af1-a0da-8260f38fbf39', 'body': {'volumeAttachment': {'volumeId': 'a750a2a2-6bba-4fe4-a833-eb8b1644fc3b'}}} May 19 21:34:30.236138 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 21:34:30.236138 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:34:30.236138 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 19 21:34:30.236138 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 19 21:34:30.236138 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 19 21:34:30.236138 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 19 21:34:30.236138 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 19 21:34:30.236138 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 19 21:34:30.236138 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a18b9269-6ed1-4af1-a0da-8260f38fbf39 in vm_state rescued. Cannot attach_volume while the instance is in this state. May 19 21:34:30.236138 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:34:30.236138 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 21:34:30.236138 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:34:30.236138 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:34:30.236138 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 21:34:30.236138 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 21:34:30.236138 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 21:34:30.236138 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 21:34:30.237917 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 21:34:30.237917 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 21:34:30.237917 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 21:34:30.237917 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 21:34:30.237917 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 21:34:30.237917 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 21:34:30.237917 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 21:34:30.237917 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 21:34:30.237917 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create May 19 21:34:30.237917 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 19 21:34:30.237917 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 19 21:34:30.237917 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 19 21:34:30.237917 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance a18b9269-6ed1-4af1-a0da-8260f38fbf39 while it is in vm_state rescued May 19 21:34:30.237917 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:34:30.237917 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 21:34:30.237917 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:34:30.237917 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:34:30.237917 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 21:34:30.237917 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 21:34:30.240181 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 21:34:30.240181 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 21:34:30.240181 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance a18b9269-6ed1-4af1-a0da-8260f38fbf39 while it is in vm_state rescued May 19 21:34:30.240181 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:34:30.240181 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-08f1be3a-396e-48ba-a0da-eef9c9c6d531 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Returning 409 to user: Cannot 'attach_volume' instance a18b9269-6ed1-4af1-a0da-8260f38fbf39 while it is in vm_state rescued {{(pid=124349) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 21:34:30.240181 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-08f1be3a-396e-48ba-a0da-eef9c9c6d531 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "POST /compute/v2.1/servers/a18b9269-6ed1-4af1-a0da-8260f38fbf39/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.075834 May 19 21:34:30.240181 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 133/276] 10.222.0.65 () {60 vars in 1322 bytes} [Thu May 19 21:34:30 2022] POST /compute/v2.1/servers/a18b9269-6ed1-4af1-a0da-8260f38fbf39/os-volume_attachments => generated 152 bytes in 78 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 19 21:34:30.254072 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-6676cfaf-c300-46fe-961d-f82284b18490 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:34:30.255455 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-6676cfaf-c300-46fe-961d-f82284b18490 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: a18b9269-6ed1-4af1-a0da-8260f38fbf39] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:34:30.266870 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6676cfaf-c300-46fe-961d-f82284b18490 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:30.267687 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6676cfaf-c300-46fe-961d-f82284b18490 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:30.269082 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6676cfaf-c300-46fe-961d-f82284b18490 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:30.269849 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6676cfaf-c300-46fe-961d-f82284b18490 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:30.382457 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-6676cfaf-c300-46fe-961d-f82284b18490 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "POST /compute/v2.1/servers/a18b9269-6ed1-4af1-a0da-8260f38fbf39/action" status: 202 len: 0 microversion: 2.1 time: 0.137511 May 19 21:34:30.383804 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 144/277] 10.222.0.65 () {60 vars in 1277 bytes} [Thu May 19 21:34:30 2022] POST /compute/v2.1/servers/a18b9269-6ed1-4af1-a0da-8260f38fbf39/action => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 21:34:30.397095 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-7a018833-55c0-47bf-88a2-06791569b94f tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:34:30.398624 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-7a018833-55c0-47bf-88a2-06791569b94f tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: a18b9269-6ed1-4af1-a0da-8260f38fbf39] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:34:30.412201 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-7a018833-55c0-47bf-88a2-06791569b94f tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:30.413283 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-7a018833-55c0-47bf-88a2-06791569b94f tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:30.415004 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-7a018833-55c0-47bf-88a2-06791569b94f tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:30.417819 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-7a018833-55c0-47bf-88a2-06791569b94f tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:30.633085 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-7a018833-55c0-47bf-88a2-06791569b94f tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1589968f375946a38e82ec484afc837f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c62c1f3c54f568abdac37360ab457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:34:30.642487 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-7a018833-55c0-47bf-88a2-06791569b94f tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "GET /compute/v2.1/servers/a18b9269-6ed1-4af1-a0da-8260f38fbf39" status: 200 len: 1511 microversion: 2.1 time: 0.251819 May 19 21:34:30.643078 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 134/278] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:34:30 2022] GET /compute/v2.1/servers/a18b9269-6ed1-4af1-a0da-8260f38fbf39 => generated 1511 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:34:30.989219 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-959ae3f5-5fb1-4711-8022-ca191e57a879 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:34:30.990462 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-959ae3f5-5fb1-4711-8022-ca191e57a879 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] [instance: 4a2fe4f6-f020-4fdc-bb72-ffe298b56627] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:34:31.000526 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-959ae3f5-5fb1-4711-8022-ca191e57a879 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:31.001159 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-959ae3f5-5fb1-4711-8022-ca191e57a879 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:31.002233 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-959ae3f5-5fb1-4711-8022-ca191e57a879 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:31.004468 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-959ae3f5-5fb1-4711-8022-ca191e57a879 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:31.306893 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-959ae3f5-5fb1-4711-8022-ca191e57a879 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47575a76d62b4a109fda03f4bf016fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c4f4baaf8f4a258171bf97abdc8905', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:34:31.317870 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-959ae3f5-5fb1-4711-8022-ca191e57a879 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] 10.222.0.65 "GET /compute/v2.1/servers/4a2fe4f6-f020-4fdc-bb72-ffe298b56627" status: 200 len: 1502 microversion: 2.1 time: 0.335068 May 19 21:34:31.330677 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 145/279] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:34:30 2022] GET /compute/v2.1/servers/4a2fe4f6-f020-4fdc-bb72-ffe298b56627 => generated 1502 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 21:34:31.664706 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-60d9c845-7897-4d56-b77b-8e501621a62e tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:34:31.666152 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-60d9c845-7897-4d56-b77b-8e501621a62e tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: a18b9269-6ed1-4af1-a0da-8260f38fbf39] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:34:31.677516 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-60d9c845-7897-4d56-b77b-8e501621a62e tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:31.678392 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-60d9c845-7897-4d56-b77b-8e501621a62e tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:31.680152 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-60d9c845-7897-4d56-b77b-8e501621a62e tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:31.681256 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-60d9c845-7897-4d56-b77b-8e501621a62e tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:31.924283 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-60d9c845-7897-4d56-b77b-8e501621a62e tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1589968f375946a38e82ec484afc837f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c62c1f3c54f568abdac37360ab457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:34:31.934517 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-60d9c845-7897-4d56-b77b-8e501621a62e tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "GET /compute/v2.1/servers/a18b9269-6ed1-4af1-a0da-8260f38fbf39" status: 200 len: 1511 microversion: 2.1 time: 0.276349 May 19 21:34:31.935550 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 135/280] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:34:31 2022] GET /compute/v2.1/servers/a18b9269-6ed1-4af1-a0da-8260f38fbf39 => generated 1511 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:34:32.346886 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-8beaa453-f300-4c93-a5ca-0dd4f2952843 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:34:32.348288 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-8beaa453-f300-4c93-a5ca-0dd4f2952843 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] [instance: 4a2fe4f6-f020-4fdc-bb72-ffe298b56627] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:34:32.361395 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8beaa453-f300-4c93-a5ca-0dd4f2952843 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:32.362560 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8beaa453-f300-4c93-a5ca-0dd4f2952843 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:32.363885 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8beaa453-f300-4c93-a5ca-0dd4f2952843 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:32.365231 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8beaa453-f300-4c93-a5ca-0dd4f2952843 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:32.584688 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-8beaa453-f300-4c93-a5ca-0dd4f2952843 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47575a76d62b4a109fda03f4bf016fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c4f4baaf8f4a258171bf97abdc8905', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:34:32.592360 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-8beaa453-f300-4c93-a5ca-0dd4f2952843 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] 10.222.0.65 "GET /compute/v2.1/servers/4a2fe4f6-f020-4fdc-bb72-ffe298b56627" status: 200 len: 1502 microversion: 2.1 time: 0.254138 May 19 21:34:32.593101 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 146/281] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:34:32 2022] GET /compute/v2.1/servers/4a2fe4f6-f020-4fdc-bb72-ffe298b56627 => generated 1502 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:34:32.961143 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-b65290a3-4fc9-401f-abe6-63b808b20b82 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:34:32.962372 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-b65290a3-4fc9-401f-abe6-63b808b20b82 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: a18b9269-6ed1-4af1-a0da-8260f38fbf39] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:34:32.975057 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-b65290a3-4fc9-401f-abe6-63b808b20b82 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:32.975687 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-b65290a3-4fc9-401f-abe6-63b808b20b82 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:32.976590 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-b65290a3-4fc9-401f-abe6-63b808b20b82 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:32.977237 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-b65290a3-4fc9-401f-abe6-63b808b20b82 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:33.175989 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-b65290a3-4fc9-401f-abe6-63b808b20b82 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1589968f375946a38e82ec484afc837f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c62c1f3c54f568abdac37360ab457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:34:33.185045 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-b65290a3-4fc9-401f-abe6-63b808b20b82 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "GET /compute/v2.1/servers/a18b9269-6ed1-4af1-a0da-8260f38fbf39" status: 200 len: 1511 microversion: 2.1 time: 0.228032 May 19 21:34:33.186125 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 136/282] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:34:32 2022] GET /compute/v2.1/servers/a18b9269-6ed1-4af1-a0da-8260f38fbf39 => generated 1511 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:34:33.616717 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-f856d50c-958f-47e0-9b3d-98838b662bbf tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:34:33.617881 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-f856d50c-958f-47e0-9b3d-98838b662bbf tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] [instance: 4a2fe4f6-f020-4fdc-bb72-ffe298b56627] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:34:33.626853 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f856d50c-958f-47e0-9b3d-98838b662bbf tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:33.627802 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f856d50c-958f-47e0-9b3d-98838b662bbf tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:33.629129 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f856d50c-958f-47e0-9b3d-98838b662bbf tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:33.629839 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f856d50c-958f-47e0-9b3d-98838b662bbf tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:33.891171 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-f856d50c-958f-47e0-9b3d-98838b662bbf tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47575a76d62b4a109fda03f4bf016fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c4f4baaf8f4a258171bf97abdc8905', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:34:33.903672 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-f856d50c-958f-47e0-9b3d-98838b662bbf tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] 10.222.0.65 "GET /compute/v2.1/servers/4a2fe4f6-f020-4fdc-bb72-ffe298b56627" status: 200 len: 1502 microversion: 2.1 time: 0.293994 May 19 21:34:33.910813 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 147/283] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:34:33 2022] GET /compute/v2.1/servers/4a2fe4f6-f020-4fdc-bb72-ffe298b56627 => generated 1502 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:34:34.210486 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-58c5fb99-0db9-4f5b-b834-dcad5affe047 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:34:34.211721 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-58c5fb99-0db9-4f5b-b834-dcad5affe047 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: a18b9269-6ed1-4af1-a0da-8260f38fbf39] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:34:34.219444 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-58c5fb99-0db9-4f5b-b834-dcad5affe047 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:34.219936 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-58c5fb99-0db9-4f5b-b834-dcad5affe047 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:34.220945 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-58c5fb99-0db9-4f5b-b834-dcad5affe047 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:34.221373 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-58c5fb99-0db9-4f5b-b834-dcad5affe047 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:34.427567 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-58c5fb99-0db9-4f5b-b834-dcad5affe047 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1589968f375946a38e82ec484afc837f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c62c1f3c54f568abdac37360ab457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:34:34.431736 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_cell1:SELECT=100 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:34:34.437944 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-58c5fb99-0db9-4f5b-b834-dcad5affe047 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "GET /compute/v2.1/servers/a18b9269-6ed1-4af1-a0da-8260f38fbf39" status: 200 len: 1511 microversion: 2.1 time: 0.232150 May 19 21:34:34.438584 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 137/284] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:34:34 2022] GET /compute/v2.1/servers/a18b9269-6ed1-4af1-a0da-8260f38fbf39 => generated 1511 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:34:34.921298 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-b9bd638e-3e17-4e96-b4ec-7b39c918c97f tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:34:34.922642 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-b9bd638e-3e17-4e96-b4ec-7b39c918c97f tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] [instance: 4a2fe4f6-f020-4fdc-bb72-ffe298b56627] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:34:34.931778 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b9bd638e-3e17-4e96-b4ec-7b39c918c97f tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:34.932532 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b9bd638e-3e17-4e96-b4ec-7b39c918c97f tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:34.933396 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b9bd638e-3e17-4e96-b4ec-7b39c918c97f tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:34.933930 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b9bd638e-3e17-4e96-b4ec-7b39c918c97f tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:35.212936 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-b9bd638e-3e17-4e96-b4ec-7b39c918c97f tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47575a76d62b4a109fda03f4bf016fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c4f4baaf8f4a258171bf97abdc8905', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:34:35.224180 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-b9bd638e-3e17-4e96-b4ec-7b39c918c97f tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] 10.222.0.65 "GET /compute/v2.1/servers/4a2fe4f6-f020-4fdc-bb72-ffe298b56627" status: 200 len: 1502 microversion: 2.1 time: 0.306073 May 19 21:34:35.225506 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 148/285] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:34:34 2022] GET /compute/v2.1/servers/4a2fe4f6-f020-4fdc-bb72-ffe298b56627 => generated 1502 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:34:35.458022 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-291d7fa0-4127-4372-b153-26e1609a9b8d tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:34:35.459232 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-291d7fa0-4127-4372-b153-26e1609a9b8d tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: a18b9269-6ed1-4af1-a0da-8260f38fbf39] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:34:35.467369 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-291d7fa0-4127-4372-b153-26e1609a9b8d tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:35.470723 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-291d7fa0-4127-4372-b153-26e1609a9b8d tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:35.476295 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-291d7fa0-4127-4372-b153-26e1609a9b8d tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:35.476751 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-291d7fa0-4127-4372-b153-26e1609a9b8d tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:35.727978 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-291d7fa0-4127-4372-b153-26e1609a9b8d tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1589968f375946a38e82ec484afc837f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c62c1f3c54f568abdac37360ab457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:34:35.752091 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-291d7fa0-4127-4372-b153-26e1609a9b8d tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "GET /compute/v2.1/servers/a18b9269-6ed1-4af1-a0da-8260f38fbf39" status: 200 len: 1511 microversion: 2.1 time: 0.299080 May 19 21:34:35.752993 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 138/286] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:34:35 2022] GET /compute/v2.1/servers/a18b9269-6ed1-4af1-a0da-8260f38fbf39 => generated 1511 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:34:36.242952 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-7d146774-f1b9-4280-97eb-b654060a65cb tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:34:36.243551 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-7d146774-f1b9-4280-97eb-b654060a65cb tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] [instance: 4a2fe4f6-f020-4fdc-bb72-ffe298b56627] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:34:36.250332 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7d146774-f1b9-4280-97eb-b654060a65cb tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:36.250773 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7d146774-f1b9-4280-97eb-b654060a65cb tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:36.251532 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7d146774-f1b9-4280-97eb-b654060a65cb tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:36.251954 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7d146774-f1b9-4280-97eb-b654060a65cb tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:36.316046 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:34:36.527593 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-7d146774-f1b9-4280-97eb-b654060a65cb tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47575a76d62b4a109fda03f4bf016fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c4f4baaf8f4a258171bf97abdc8905', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:34:36.552995 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-7d146774-f1b9-4280-97eb-b654060a65cb tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] 10.222.0.65 "GET /compute/v2.1/servers/4a2fe4f6-f020-4fdc-bb72-ffe298b56627" status: 200 len: 1502 microversion: 2.1 time: 0.314236 May 19 21:34:36.554665 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 149/287] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:34:36 2022] GET /compute/v2.1/servers/4a2fe4f6-f020-4fdc-bb72-ffe298b56627 => generated 1502 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:34:36.772498 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-1746aee3-58ea-4844-9e8e-e8587bc68f1d tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:34:36.773429 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-1746aee3-58ea-4844-9e8e-e8587bc68f1d tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: a18b9269-6ed1-4af1-a0da-8260f38fbf39] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:34:36.780283 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1746aee3-58ea-4844-9e8e-e8587bc68f1d tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:36.780727 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1746aee3-58ea-4844-9e8e-e8587bc68f1d tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:36.781910 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1746aee3-58ea-4844-9e8e-e8587bc68f1d tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:36.782405 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1746aee3-58ea-4844-9e8e-e8587bc68f1d tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:37.001124 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-1746aee3-58ea-4844-9e8e-e8587bc68f1d tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1589968f375946a38e82ec484afc837f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c62c1f3c54f568abdac37360ab457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:34:37.011613 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-1746aee3-58ea-4844-9e8e-e8587bc68f1d tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "GET /compute/v2.1/servers/a18b9269-6ed1-4af1-a0da-8260f38fbf39" status: 200 len: 1511 microversion: 2.1 time: 0.244992 May 19 21:34:37.015654 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 139/288] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:34:36 2022] GET /compute/v2.1/servers/a18b9269-6ed1-4af1-a0da-8260f38fbf39 => generated 1511 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:34:37.571976 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-9181ae66-51ef-44f7-8c2d-4503e2fda1c5 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:34:37.572719 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-9181ae66-51ef-44f7-8c2d-4503e2fda1c5 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] [instance: 4a2fe4f6-f020-4fdc-bb72-ffe298b56627] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:34:37.599222 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9181ae66-51ef-44f7-8c2d-4503e2fda1c5 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:37.600171 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9181ae66-51ef-44f7-8c2d-4503e2fda1c5 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:37.602317 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9181ae66-51ef-44f7-8c2d-4503e2fda1c5 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:37.603153 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9181ae66-51ef-44f7-8c2d-4503e2fda1c5 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:38.035708 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-e5b36808-bc02-4f12-a45b-e5000fe34a98 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:34:38.037795 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-e5b36808-bc02-4f12-a45b-e5000fe34a98 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: a18b9269-6ed1-4af1-a0da-8260f38fbf39] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:34:38.047702 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-9181ae66-51ef-44f7-8c2d-4503e2fda1c5 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47575a76d62b4a109fda03f4bf016fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c4f4baaf8f4a258171bf97abdc8905', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:34:38.054584 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e5b36808-bc02-4f12-a45b-e5000fe34a98 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:38.055798 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e5b36808-bc02-4f12-a45b-e5000fe34a98 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:38.057429 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e5b36808-bc02-4f12-a45b-e5000fe34a98 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:38.058200 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e5b36808-bc02-4f12-a45b-e5000fe34a98 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:38.062034 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-9181ae66-51ef-44f7-8c2d-4503e2fda1c5 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] 10.222.0.65 "GET /compute/v2.1/servers/4a2fe4f6-f020-4fdc-bb72-ffe298b56627" status: 200 len: 1502 microversion: 2.1 time: 0.494649 May 19 21:34:38.062597 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 150/289] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:34:37 2022] GET /compute/v2.1/servers/4a2fe4f6-f020-4fdc-bb72-ffe298b56627 => generated 1502 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:34:38.695144 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-e5b36808-bc02-4f12-a45b-e5000fe34a98 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1589968f375946a38e82ec484afc837f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c62c1f3c54f568abdac37360ab457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:34:38.731561 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-e5b36808-bc02-4f12-a45b-e5000fe34a98 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "GET /compute/v2.1/servers/a18b9269-6ed1-4af1-a0da-8260f38fbf39" status: 200 len: 1511 microversion: 2.1 time: 0.702309 May 19 21:34:38.735075 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 140/290] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:34:38 2022] GET /compute/v2.1/servers/a18b9269-6ed1-4af1-a0da-8260f38fbf39 => generated 1511 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:34:39.088515 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-83238759-d11b-4a89-84b2-b9304c6c799d tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:34:39.091783 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-83238759-d11b-4a89-84b2-b9304c6c799d tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] [instance: 4a2fe4f6-f020-4fdc-bb72-ffe298b56627] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:34:39.107835 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-83238759-d11b-4a89-84b2-b9304c6c799d tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:39.108635 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-83238759-d11b-4a89-84b2-b9304c6c799d tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:39.109414 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-83238759-d11b-4a89-84b2-b9304c6c799d tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:39.109843 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-83238759-d11b-4a89-84b2-b9304c6c799d tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:39.166327 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [req-01dc58f0-d88a-42b4-a539-812ae001220d req-cb5e1d5e-de28-458a-b851-49e37f1241fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a2fe4f6-f020-4fdc-bb72-ffe298b56627", "name": "network-vif-deleted", "tag": "abeca8c2-0922-427b-bde2-2a81f568efa5"}]} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:34:39.182473 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-01dc58f0-d88a-42b4-a539-812ae001220d req-cb5e1d5e-de28-458a-b851-49e37f1241fa service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:39.183090 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-01dc58f0-d88a-42b4-a539-812ae001220d req-cb5e1d5e-de28-458a-b851-49e37f1241fa service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:39.198576 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.compute.server_external_events [req-01dc58f0-d88a-42b4-a539-812ae001220d req-cb5e1d5e-de28-458a-b851-49e37f1241fa service nova] Creating event network-vif-deleted:abeca8c2-0922-427b-bde2-2a81f568efa5 for instance 4a2fe4f6-f020-4fdc-bb72-ffe298b56627 on hv-cinder-83563 May 19 21:34:39.207388 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [req-01dc58f0-d88a-42b4-a539-812ae001220d req-cb5e1d5e-de28-458a-b851-49e37f1241fa service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045038 May 19 21:34:39.211031 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 141/291] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 21:34:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 21:34:39.251739 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-83238759-d11b-4a89-84b2-b9304c6c799d tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47575a76d62b4a109fda03f4bf016fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c4f4baaf8f4a258171bf97abdc8905', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:34:39.262892 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-83238759-d11b-4a89-84b2-b9304c6c799d tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] 10.222.0.65 "GET /compute/v2.1/servers/4a2fe4f6-f020-4fdc-bb72-ffe298b56627" status: 200 len: 1460 microversion: 2.1 time: 0.184983 May 19 21:34:39.264307 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 151/292] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:34:39 2022] GET /compute/v2.1/servers/4a2fe4f6-f020-4fdc-bb72-ffe298b56627 => generated 1460 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:34:39.761320 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-7258fdd8-bd2e-4ede-9158-37d5de19efbe tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:34:39.763427 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-7258fdd8-bd2e-4ede-9158-37d5de19efbe tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: a18b9269-6ed1-4af1-a0da-8260f38fbf39] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:34:39.806951 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-7258fdd8-bd2e-4ede-9158-37d5de19efbe tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:39.810735 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-7258fdd8-bd2e-4ede-9158-37d5de19efbe tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:39.812016 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-7258fdd8-bd2e-4ede-9158-37d5de19efbe tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:39.812477 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-7258fdd8-bd2e-4ede-9158-37d5de19efbe tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:40.124921 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-7258fdd8-bd2e-4ede-9158-37d5de19efbe tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1589968f375946a38e82ec484afc837f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c62c1f3c54f568abdac37360ab457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:34:40.140884 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-7258fdd8-bd2e-4ede-9158-37d5de19efbe tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "GET /compute/v2.1/servers/a18b9269-6ed1-4af1-a0da-8260f38fbf39" status: 200 len: 1511 microversion: 2.1 time: 0.390521 May 19 21:34:40.143450 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 142/293] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:34:39 2022] GET /compute/v2.1/servers/a18b9269-6ed1-4af1-a0da-8260f38fbf39 => generated 1511 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:34:40.285376 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-84e3d110-dfeb-4ceb-ba7d-ffd54acc2b1b tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:34:40.290587 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-84e3d110-dfeb-4ceb-ba7d-ffd54acc2b1b tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] [instance: 4a2fe4f6-f020-4fdc-bb72-ffe298b56627] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:34:40.298645 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:34:40.307140 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-84e3d110-dfeb-4ceb-ba7d-ffd54acc2b1b tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:40.307989 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-84e3d110-dfeb-4ceb-ba7d-ffd54acc2b1b tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:40.309190 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-84e3d110-dfeb-4ceb-ba7d-ffd54acc2b1b tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:40.310280 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-84e3d110-dfeb-4ceb-ba7d-ffd54acc2b1b tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:40.369352 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-84e3d110-dfeb-4ceb-ba7d-ffd54acc2b1b tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:40.369908 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-84e3d110-dfeb-4ceb-ba7d-ffd54acc2b1b tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:40.371132 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.objects.instance [None req-84e3d110-dfeb-4ceb-ba7d-ffd54acc2b1b tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lazy-loading 'fault' on Instance uuid 4a2fe4f6-f020-4fdc-bb72-ffe298b56627 {{(pid=124350) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 21:34:40.444399 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-84e3d110-dfeb-4ceb-ba7d-ffd54acc2b1b tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47575a76d62b4a109fda03f4bf016fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c4f4baaf8f4a258171bf97abdc8905', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:34:40.479384 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-84e3d110-dfeb-4ceb-ba7d-ffd54acc2b1b tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] 10.222.0.65 "GET /compute/v2.1/servers/4a2fe4f6-f020-4fdc-bb72-ffe298b56627" status: 200 len: 1303 microversion: 2.1 time: 0.201341 May 19 21:34:40.488723 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 152/294] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:34:40 2022] GET /compute/v2.1/servers/4a2fe4f6-f020-4fdc-bb72-ffe298b56627 => generated 1303 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:34:41.167840 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-f0a65c0a-07dc-41d1-b628-e5101b0a5dc1 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:34:41.170164 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-f0a65c0a-07dc-41d1-b628-e5101b0a5dc1 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: a18b9269-6ed1-4af1-a0da-8260f38fbf39] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:34:41.182229 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f0a65c0a-07dc-41d1-b628-e5101b0a5dc1 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:41.183241 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f0a65c0a-07dc-41d1-b628-e5101b0a5dc1 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:41.184718 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f0a65c0a-07dc-41d1-b628-e5101b0a5dc1 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:41.185802 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f0a65c0a-07dc-41d1-b628-e5101b0a5dc1 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:41.495870 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-f0a65c0a-07dc-41d1-b628-e5101b0a5dc1 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1589968f375946a38e82ec484afc837f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c62c1f3c54f568abdac37360ab457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:34:41.510375 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-b85c1e40-8030-4ad3-b1b3-632ab7ad0ed8 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:34:41.511738 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-b85c1e40-8030-4ad3-b1b3-632ab7ad0ed8 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] [instance: 4a2fe4f6-f020-4fdc-bb72-ffe298b56627] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:34:41.526566 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b85c1e40-8030-4ad3-b1b3-632ab7ad0ed8 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:41.527547 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b85c1e40-8030-4ad3-b1b3-632ab7ad0ed8 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:41.529386 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b85c1e40-8030-4ad3-b1b3-632ab7ad0ed8 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:41.530348 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b85c1e40-8030-4ad3-b1b3-632ab7ad0ed8 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:41.561642 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-f0a65c0a-07dc-41d1-b628-e5101b0a5dc1 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "GET /compute/v2.1/servers/a18b9269-6ed1-4af1-a0da-8260f38fbf39" status: 200 len: 1511 microversion: 2.1 time: 0.385637 May 19 21:34:41.577199 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 143/295] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:34:41 2022] GET /compute/v2.1/servers/a18b9269-6ed1-4af1-a0da-8260f38fbf39 => generated 1511 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:34:41.619199 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b85c1e40-8030-4ad3-b1b3-632ab7ad0ed8 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:41.620999 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b85c1e40-8030-4ad3-b1b3-632ab7ad0ed8 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:41.622121 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.objects.instance [None req-b85c1e40-8030-4ad3-b1b3-632ab7ad0ed8 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lazy-loading 'fault' on Instance uuid 4a2fe4f6-f020-4fdc-bb72-ffe298b56627 {{(pid=124350) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 21:34:41.697885 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-b85c1e40-8030-4ad3-b1b3-632ab7ad0ed8 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47575a76d62b4a109fda03f4bf016fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c4f4baaf8f4a258171bf97abdc8905', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:34:41.709282 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-b85c1e40-8030-4ad3-b1b3-632ab7ad0ed8 tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] 10.222.0.65 "GET /compute/v2.1/servers/4a2fe4f6-f020-4fdc-bb72-ffe298b56627" status: 200 len: 1303 microversion: 2.1 time: 0.208099 May 19 21:34:41.709973 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 153/296] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:34:41 2022] GET /compute/v2.1/servers/4a2fe4f6-f020-4fdc-bb72-ffe298b56627 => generated 1303 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:34:42.588561 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-f10dad98-ffb4-4d3f-ad3c-12b1b4983667 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:34:42.589411 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-f10dad98-ffb4-4d3f-ad3c-12b1b4983667 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: a18b9269-6ed1-4af1-a0da-8260f38fbf39] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:34:42.601176 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f10dad98-ffb4-4d3f-ad3c-12b1b4983667 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:42.603729 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f10dad98-ffb4-4d3f-ad3c-12b1b4983667 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:42.604714 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f10dad98-ffb4-4d3f-ad3c-12b1b4983667 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:42.609313 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f10dad98-ffb4-4d3f-ad3c-12b1b4983667 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:42.759211 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-6a16464c-7e9c-4d3c-9bd1-e89d7be67bec tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:34:42.760789 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-6a16464c-7e9c-4d3c-9bd1-e89d7be67bec tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] [instance: 4a2fe4f6-f020-4fdc-bb72-ffe298b56627] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:34:42.788476 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6a16464c-7e9c-4d3c-9bd1-e89d7be67bec tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:42.789591 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6a16464c-7e9c-4d3c-9bd1-e89d7be67bec tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:42.794350 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6a16464c-7e9c-4d3c-9bd1-e89d7be67bec tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:42.795655 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6a16464c-7e9c-4d3c-9bd1-e89d7be67bec tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:42.929145 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6a16464c-7e9c-4d3c-9bd1-e89d7be67bec tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:42.932478 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6a16464c-7e9c-4d3c-9bd1-e89d7be67bec tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:42.935438 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.objects.instance [None req-6a16464c-7e9c-4d3c-9bd1-e89d7be67bec tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lazy-loading 'fault' on Instance uuid 4a2fe4f6-f020-4fdc-bb72-ffe298b56627 {{(pid=124350) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 21:34:43.050135 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-f10dad98-ffb4-4d3f-ad3c-12b1b4983667 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1589968f375946a38e82ec484afc837f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c62c1f3c54f568abdac37360ab457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:34:43.061186 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-f10dad98-ffb4-4d3f-ad3c-12b1b4983667 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "GET /compute/v2.1/servers/a18b9269-6ed1-4af1-a0da-8260f38fbf39" status: 200 len: 1517 microversion: 2.1 time: 0.476400 May 19 21:34:43.062653 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 144/297] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:34:42 2022] GET /compute/v2.1/servers/a18b9269-6ed1-4af1-a0da-8260f38fbf39 => generated 1517 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:34:43.166129 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-6a16464c-7e9c-4d3c-9bd1-e89d7be67bec tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47575a76d62b4a109fda03f4bf016fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c4f4baaf8f4a258171bf97abdc8905', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:34:43.177540 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-6a16464c-7e9c-4d3c-9bd1-e89d7be67bec tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] 10.222.0.65 "GET /compute/v2.1/servers/4a2fe4f6-f020-4fdc-bb72-ffe298b56627" status: 200 len: 1303 microversion: 2.1 time: 0.438438 May 19 21:34:43.184091 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 154/298] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:34:42 2022] GET /compute/v2.1/servers/4a2fe4f6-f020-4fdc-bb72-ffe298b56627 => generated 1303 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:34:44.203568 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-7cdf9013-06bc-4a3d-9a24-28aefe53df9f tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:34:44.206291 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-7cdf9013-06bc-4a3d-9a24-28aefe53df9f tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] [instance: 4a2fe4f6-f020-4fdc-bb72-ffe298b56627] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:34:44.224243 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-7cdf9013-06bc-4a3d-9a24-28aefe53df9f tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:44.225535 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-7cdf9013-06bc-4a3d-9a24-28aefe53df9f tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:44.228236 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-7cdf9013-06bc-4a3d-9a24-28aefe53df9f tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:44.230425 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-7cdf9013-06bc-4a3d-9a24-28aefe53df9f tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:44.269567 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.wsgi [None req-7cdf9013-06bc-4a3d-9a24-28aefe53df9f tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] HTTP exception thrown: Instance 4a2fe4f6-f020-4fdc-bb72-ffe298b56627 could not be found. May 19 21:34:44.277492 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-7cdf9013-06bc-4a3d-9a24-28aefe53df9f tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Request method failure captured: May 19 21:34:44.277492 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: request: GET /compute/v2.1/servers/4a2fe4f6-f020-4fdc-bb72-ffe298b56627 HTTP/1.1 May 19 21:34:44.277492 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Accept: application/json May 19 21:34:44.277492 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Accept-Encoding: identity May 19 21:34:44.277492 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Connection: close May 19 21:34:44.277492 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Content-Length: 0 May 19 21:34:44.277492 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Content-Type: application/json May 19 21:34:44.277492 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Host: 10.222.0.65 May 19 21:34:44.277492 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Openstack-System-Scope: None May 19 21:34:44.277492 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: User-Agent: python-urllib3/1.26.9 May 19 21:34:44.277492 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Auth-Token: gAAAAABihree51pjleWDuUTPwfAUNntWiYmbXZCEzZ_lVhZ3HLTnsojdxtVMVFZic78xHDYbKRF5OcJmkV4_2QxroF9tZyLMjs-XsEmdxOpGWcxgsjPGYzGrLYKep_DZ3bmDV97NRHQ0UtzOxIPPR-_I1PIIPxo151cHox8z6a1mqBdfMGDouLM May 19 21:34:44.277492 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Domain-Id: None May 19 21:34:44.277492 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Domain-Name: None May 19 21:34:44.277492 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Identity-Status: Confirmed May 19 21:34:44.277492 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Is-Admin-Project: True May 19 21:34:44.277492 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Project-Domain-Id: default May 19 21:34:44.277492 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Project-Domain-Name: Default May 19 21:34:44.277492 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Project-Id: f9c4f4baaf8f4a258171bf97abdc8905 May 19 21:34:44.277492 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Project-Name: tempest-VolumesActionsTest-1142953549 May 19 21:34:44.277492 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Role: reader,member May 19 21:34:44.277492 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Roles: reader,member May 19 21:34:44.279167 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/f9c4f4baaf8f4a258171bf97abdc8905"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/f9c4f4baaf8f4a258171bf97abdc8905"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_f9c4f4baaf8f4a258171bf97abdc8905"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/f9c4f4baaf8f4a258171bf97abdc8905"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}] May 19 21:34:44.279167 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Tenant: tempest-VolumesActionsTest-1142953549 May 19 21:34:44.279167 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Tenant-Id: f9c4f4baaf8f4a258171bf97abdc8905 May 19 21:34:44.279167 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Tenant-Name: tempest-VolumesActionsTest-1142953549 May 19 21:34:44.279167 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-User: tempest-VolumesActionsTest-1142953549-project May 19 21:34:44.279167 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-User-Domain-Id: default May 19 21:34:44.279167 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-User-Domain-Name: Default May 19 21:34:44.279167 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-User-Id: 47575a76d62b4a109fda03f4bf016fc6 May 19 21:34:44.279167 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-User-Name: tempest-VolumesActionsTest-1142953549-project May 19 21:34:44.279167 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: method: > May 19 21:34:44.279167 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: exception: Instance 4a2fe4f6-f020-4fdc-bb72-ffe298b56627 could not be found. May 19 21:34:44.279167 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: action_args: {'id': '4a2fe4f6-f020-4fdc-bb72-ffe298b56627'} May 19 21:34:44.280193 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 21:34:44.280193 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:34:44.280193 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 21:34:44.280193 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 21:34:44.280193 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 21:34:44.280193 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 21:34:44.280193 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 21:34:44.280193 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 21:34:44.280193 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 21:34:44.280193 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 21:34:44.280193 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a2fe4f6-f020-4fdc-bb72-ffe298b56627 could not be found. May 19 21:34:44.280193 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:34:44.280193 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 21:34:44.280193 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:34:44.280193 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:34:44.280193 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 21:34:44.280193 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 21:34:44.280193 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 21:34:44.280193 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 21:34:44.280193 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 21:34:44.281671 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 21:34:44.281671 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 21:34:44.281671 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 21:34:44.281671 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 21:34:44.281671 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 21:34:44.281671 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 21:34:44.281671 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 21:34:44.281671 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a2fe4f6-f020-4fdc-bb72-ffe298b56627 could not be found. May 19 21:34:44.281671 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:34:44.281671 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 21:34:44.281671 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:34:44.281671 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:34:44.281671 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 21:34:44.281671 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 21:34:44.281671 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 21:34:44.281671 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 21:34:44.281671 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a2fe4f6-f020-4fdc-bb72-ffe298b56627 could not be found. May 19 21:34:44.281671 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:34:44.284438 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-7cdf9013-06bc-4a3d-9a24-28aefe53df9f tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] Returning 404 to user: Instance 4a2fe4f6-f020-4fdc-bb72-ffe298b56627 could not be found. {{(pid=124349) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 21:34:44.285949 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-7cdf9013-06bc-4a3d-9a24-28aefe53df9f tempest-VolumesActionsTest-1142953549 tempest-VolumesActionsTest-1142953549-project] 10.222.0.65 "GET /compute/v2.1/servers/4a2fe4f6-f020-4fdc-bb72-ffe298b56627" status: 404 len: 111 microversion: 2.1 time: 0.089351 May 19 21:34:44.287172 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 145/299] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:34:44 2022] GET /compute/v2.1/servers/4a2fe4f6-f020-4fdc-bb72-ffe298b56627 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 21:34:46.056704 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-f8311bdd-b9c2-4762-a876-a8408a5b5455 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Action: 'create', calling method: .version_select at 0x7fe368037310>, body: {"keypair": {"name": "tempest-keypair-102709342", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGU/AhYDpmd1i0Qh+2x1L8IwpUsrXGDhvA1ZlFVHLE6Zgt1JOf9KTKX+15qAQ7SA7b5yKa6+lO8VPok06oRT06GmNJsnu24G2ptF0IPobN/WYeH9zz/wlEO1D+YRLYw0Nw=="}} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:34:46.121928 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.quota [None req-f8311bdd-b9c2-4762-a876-a8408a5b5455 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Getting quotas for project 985c62c1f3c54f568abdac37360ab457. Resources: {'key_pairs'} {{(pid=124350) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 21:34:46.139458 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.quota [None req-f8311bdd-b9c2-4762-a876-a8408a5b5455 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Getting quotas for user 1589968f375946a38e82ec484afc837f and project 985c62c1f3c54f568abdac37360ab457. Resources: {'key_pairs'} {{(pid=124350) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 21:34:46.218853 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-f8311bdd-b9c2-4762-a876-a8408a5b5455 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.163590 May 19 21:34:46.218853 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 155/300] 10.222.0.65 () {60 vars in 1158 bytes} [Thu May 19 21:34:46 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 21:34:48.870561 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-65e2f194-1b60-43f5-914e-5676639bc38d tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1449201659", "imageRef": "a874457a-f8a8-46f6-bdcc-1fa632a0d3c0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c14ce0dd-3e64-476b-9ef2-fbfc9abe672b"}], "security_groups": [{"name": "tempest-securitygroup--476769185"}], "key_name": "tempest-keypair-102709342", "user_data": "}} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:34:49.107949 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.network.neutron [None req-65e2f194-1b60-43f5-914e-5676639bc38d tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] validate_networks() for [('c14ce0dd-3e64-476b-9ef2-fbfc9abe672b', None, None, None, None, None)] {{(pid=124349) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 19 21:34:49.815893 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.virt.hardware [None req-65e2f194-1b60-43f5-914e-5676639bc38d tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Flavor limits 0:0:0 {{(pid=124349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 21:34:49.817042 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.virt.hardware [None req-65e2f194-1b60-43f5-914e-5676639bc38d tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Image limits 0:0:0 {{(pid=124349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 21:34:49.817956 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.virt.hardware [None req-65e2f194-1b60-43f5-914e-5676639bc38d tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Flavor pref 0:0:0 {{(pid=124349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 21:34:49.818702 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.virt.hardware [None req-65e2f194-1b60-43f5-914e-5676639bc38d tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Image pref 0:0:0 {{(pid=124349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 21:34:49.819485 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.virt.hardware [None req-65e2f194-1b60-43f5-914e-5676639bc38d tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 21:34:49.823026 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_api:SELECT=48 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:34:49.853204 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-65e2f194-1b60-43f5-914e-5676639bc38d tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:49.855407 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-65e2f194-1b60-43f5-914e-5676639bc38d tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:49.857237 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-65e2f194-1b60-43f5-914e-5676639bc38d tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:49.859192 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-65e2f194-1b60-43f5-914e-5676639bc38d tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:49.901144 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.quota [None req-65e2f194-1b60-43f5-914e-5676639bc38d tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Getting quotas for project 985c62c1f3c54f568abdac37360ab457. Resources: {'ram', 'cores', 'instances'} {{(pid=124349) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 21:34:49.910854 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.quota [None req-65e2f194-1b60-43f5-914e-5676639bc38d tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Getting quotas for user 1589968f375946a38e82ec484afc837f and project 985c62c1f3c54f568abdac37360ab457. Resources: {'ram', 'cores', 'instances'} {{(pid=124349) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 21:34:49.935182 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-65e2f194-1b60-43f5-914e-5676639bc38d tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Going to run 1 instances... {{(pid=124349) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 21:34:49.940842 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-65e2f194-1b60-43f5-914e-5676639bc38d tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: e51de034-1fec-4513-a375-6b28e6180d82] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a874457a-f8a8-46f6-bdcc-1fa632a0d3c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124349) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 21:34:50.043281 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-65e2f194-1b60-43f5-914e-5676639bc38d tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.180615 May 19 21:34:50.044199 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 146/301] 10.222.0.65 () {60 vars in 1146 bytes} [Thu May 19 21:34:48 2022] POST /compute/v2.1/servers => generated 408 bytes in 1182 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 21:34:50.055483 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-bd3c98a0-d3f3-4a7a-b648-8c66a5925b9c tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:34:50.056394 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-bd3c98a0-d3f3-4a7a-b648-8c66a5925b9c tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: e51de034-1fec-4513-a375-6b28e6180d82] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:34:50.190545 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-bd3c98a0-d3f3-4a7a-b648-8c66a5925b9c tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1589968f375946a38e82ec484afc837f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c62c1f3c54f568abdac37360ab457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:34:50.204158 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-bd3c98a0-d3f3-4a7a-b648-8c66a5925b9c tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "GET /compute/v2.1/servers/e51de034-1fec-4513-a375-6b28e6180d82" status: 200 len: 1245 microversion: 2.1 time: 0.152882 May 19 21:34:50.204947 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 156/302] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:34:50 2022] GET /compute/v2.1/servers/e51de034-1fec-4513-a375-6b28e6180d82 => generated 1245 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:34:51.227624 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-c5d806a2-2641-45a6-924a-eaf4aabcdb75 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:34:51.228668 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-c5d806a2-2641-45a6-924a-eaf4aabcdb75 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: e51de034-1fec-4513-a375-6b28e6180d82] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:34:51.244402 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c5d806a2-2641-45a6-924a-eaf4aabcdb75 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:51.245202 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c5d806a2-2641-45a6-924a-eaf4aabcdb75 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:51.246170 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c5d806a2-2641-45a6-924a-eaf4aabcdb75 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:51.254893 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c5d806a2-2641-45a6-924a-eaf4aabcdb75 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:51.357734 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-c5d806a2-2641-45a6-924a-eaf4aabcdb75 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1589968f375946a38e82ec484afc837f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c62c1f3c54f568abdac37360ab457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:34:51.372117 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-c5d806a2-2641-45a6-924a-eaf4aabcdb75 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "GET /compute/v2.1/servers/e51de034-1fec-4513-a375-6b28e6180d82" status: 200 len: 1249 microversion: 2.1 time: 0.152296 May 19 21:34:51.374962 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 147/303] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:34:51 2022] GET /compute/v2.1/servers/e51de034-1fec-4513-a375-6b28e6180d82 => generated 1249 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:34:52.411195 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-ddeee00d-e7ee-44fe-9502-5cccb8412d46 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:34:52.412598 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-ddeee00d-e7ee-44fe-9502-5cccb8412d46 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: e51de034-1fec-4513-a375-6b28e6180d82] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:34:52.431213 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ddeee00d-e7ee-44fe-9502-5cccb8412d46 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:52.435066 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ddeee00d-e7ee-44fe-9502-5cccb8412d46 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:52.438628 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ddeee00d-e7ee-44fe-9502-5cccb8412d46 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:52.448888 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ddeee00d-e7ee-44fe-9502-5cccb8412d46 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:52.562522 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-ddeee00d-e7ee-44fe-9502-5cccb8412d46 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1589968f375946a38e82ec484afc837f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c62c1f3c54f568abdac37360ab457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:34:52.577502 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-ddeee00d-e7ee-44fe-9502-5cccb8412d46 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "GET /compute/v2.1/servers/e51de034-1fec-4513-a375-6b28e6180d82" status: 200 len: 1305 microversion: 2.1 time: 0.174101 May 19 21:34:52.579599 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 157/304] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:34:52 2022] GET /compute/v2.1/servers/e51de034-1fec-4513-a375-6b28e6180d82 => generated 1305 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:34:53.597436 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-8bde215c-200a-4236-a875-06062fa6acb1 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:34:53.598356 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-8bde215c-200a-4236-a875-06062fa6acb1 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: e51de034-1fec-4513-a375-6b28e6180d82] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:34:53.614486 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-8bde215c-200a-4236-a875-06062fa6acb1 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:53.618814 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-8bde215c-200a-4236-a875-06062fa6acb1 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:53.624519 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-8bde215c-200a-4236-a875-06062fa6acb1 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:53.625886 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-8bde215c-200a-4236-a875-06062fa6acb1 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:53.942489 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-8bde215c-200a-4236-a875-06062fa6acb1 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1589968f375946a38e82ec484afc837f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c62c1f3c54f568abdac37360ab457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:34:53.980243 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-8bde215c-200a-4236-a875-06062fa6acb1 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "GET /compute/v2.1/servers/e51de034-1fec-4513-a375-6b28e6180d82" status: 200 len: 1303 microversion: 2.1 time: 0.387076 May 19 21:34:53.991887 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 148/305] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:34:53 2022] GET /compute/v2.1/servers/e51de034-1fec-4513-a375-6b28e6180d82 => generated 1303 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:34:54.120851 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-6fd51761-beb4-4ed7-8a1e-4f6577d512c7 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2018638280", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2053369052", "security_groups": [{"name": "tempest-secgroup-smoke-1388373731"}], "block_device_mapping_v2": [{"uuid": "7c2894cf-b2c6-4427-86ee-ba2b4af04cc0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "d5d9547d-2306-4c78-9ac6-532192256ea5"}]}} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:34:54.487033 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.network.neutron [None req-6fd51761-beb4-4ed7-8a1e-4f6577d512c7 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] validate_networks() for [('d5d9547d-2306-4c78-9ac6-532192256ea5', None, None, None, None, None)] {{(pid=124350) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 19 21:34:55.008950 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-ad05e619-b05d-4b50-826e-8a1d3ff16c33 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:34:55.009579 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-ad05e619-b05d-4b50-826e-8a1d3ff16c33 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: e51de034-1fec-4513-a375-6b28e6180d82] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:34:55.019860 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ad05e619-b05d-4b50-826e-8a1d3ff16c33 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:55.022302 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ad05e619-b05d-4b50-826e-8a1d3ff16c33 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:55.027814 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ad05e619-b05d-4b50-826e-8a1d3ff16c33 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:55.032289 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ad05e619-b05d-4b50-826e-8a1d3ff16c33 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:55.313818 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-ad05e619-b05d-4b50-826e-8a1d3ff16c33 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1589968f375946a38e82ec484afc837f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c62c1f3c54f568abdac37360ab457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:34:55.328177 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-ad05e619-b05d-4b50-826e-8a1d3ff16c33 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "GET /compute/v2.1/servers/e51de034-1fec-4513-a375-6b28e6180d82" status: 200 len: 1370 microversion: 2.1 time: 0.322951 May 19 21:34:55.332182 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 149/306] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:34:55 2022] GET /compute/v2.1/servers/e51de034-1fec-4513-a375-6b28e6180d82 => generated 1370 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 21:34:55.381996 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.virt.hardware [None req-6fd51761-beb4-4ed7-8a1e-4f6577d512c7 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Flavor limits 0:0:0 {{(pid=124350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 21:34:55.383144 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.virt.hardware [None req-6fd51761-beb4-4ed7-8a1e-4f6577d512c7 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Image limits 0:0:0 {{(pid=124350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 21:34:55.383742 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.virt.hardware [None req-6fd51761-beb4-4ed7-8a1e-4f6577d512c7 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Flavor pref 0:0:0 {{(pid=124350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 21:34:55.384158 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.virt.hardware [None req-6fd51761-beb4-4ed7-8a1e-4f6577d512c7 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Image pref 0:0:0 {{(pid=124350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 21:34:55.384569 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.virt.hardware [None req-6fd51761-beb4-4ed7-8a1e-4f6577d512c7 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 21:34:55.397873 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6fd51761-beb4-4ed7-8a1e-4f6577d512c7 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:55.398464 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6fd51761-beb4-4ed7-8a1e-4f6577d512c7 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:55.399335 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6fd51761-beb4-4ed7-8a1e-4f6577d512c7 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:55.400008 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6fd51761-beb4-4ed7-8a1e-4f6577d512c7 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:55.422745 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.quota [None req-6fd51761-beb4-4ed7-8a1e-4f6577d512c7 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Getting quotas for project 4951b93f86e1485692a4aae7b9ece8f6. Resources: {'ram', 'cores', 'instances'} {{(pid=124350) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 21:34:55.427854 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.quota [None req-6fd51761-beb4-4ed7-8a1e-4f6577d512c7 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Getting quotas for user 0a58f82117ab437cab5607c204c86547 and project 4951b93f86e1485692a4aae7b9ece8f6. Resources: {'ram', 'cores', 'instances'} {{(pid=124350) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 21:34:55.538971 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-6fd51761-beb4-4ed7-8a1e-4f6577d512c7 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Going to run 1 instances... {{(pid=124350) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 21:34:55.541828 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-6fd51761-beb4-4ed7-8a1e-4f6577d512c7 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] [instance: 6442f189-c760-45c5-8313-4f1d3fe46461] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7c2894cf-b2c6-4427-86ee-ba2b4af04cc0',volume_size=None,volume_type=None)] {{(pid=124350) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 21:34:55.747978 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-6fd51761-beb4-4ed7-8a1e-4f6577d512c7 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.641170 May 19 21:34:55.749478 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 158/307] 10.222.0.65 () {60 vars in 1146 bytes} [Thu May 19 21:34:54 2022] POST /compute/v2.1/servers => generated 406 bytes in 1644 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 21:34:55.760832 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-0f4aaf9e-b9d5-4285-a7fc-ced7528a92a8 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:34:55.761816 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-0f4aaf9e-b9d5-4285-a7fc-ced7528a92a8 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] [instance: 6442f189-c760-45c5-8313-4f1d3fe46461] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:34:55.900821 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-0f4aaf9e-b9d5-4285-a7fc-ced7528a92a8 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a58f82117ab437cab5607c204c86547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4951b93f86e1485692a4aae7b9ece8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:34:55.925158 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-0f4aaf9e-b9d5-4285-a7fc-ced7528a92a8 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] 10.222.0.65 "GET /compute/v2.1/servers/6442f189-c760-45c5-8313-4f1d3fe46461" status: 200 len: 1095 microversion: 2.1 time: 0.168766 May 19 21:34:55.934932 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 150/308] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:34:55 2022] GET /compute/v2.1/servers/6442f189-c760-45c5-8313-4f1d3fe46461 => generated 1095 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:34:56.349856 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-9f34f198-dc2d-474b-ba58-16057b8725ed tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:34:56.351685 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-9f34f198-dc2d-474b-ba58-16057b8725ed tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: e51de034-1fec-4513-a375-6b28e6180d82] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:34:56.360761 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9f34f198-dc2d-474b-ba58-16057b8725ed tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:56.361361 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9f34f198-dc2d-474b-ba58-16057b8725ed tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:56.361970 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9f34f198-dc2d-474b-ba58-16057b8725ed tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:56.362445 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9f34f198-dc2d-474b-ba58-16057b8725ed tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:56.538517 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-9f34f198-dc2d-474b-ba58-16057b8725ed tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1589968f375946a38e82ec484afc837f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c62c1f3c54f568abdac37360ab457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:34:56.547203 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-9f34f198-dc2d-474b-ba58-16057b8725ed tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "GET /compute/v2.1/servers/e51de034-1fec-4513-a375-6b28e6180d82" status: 200 len: 1370 microversion: 2.1 time: 0.201569 May 19 21:34:56.548447 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 159/309] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:34:56 2022] GET /compute/v2.1/servers/e51de034-1fec-4513-a375-6b28e6180d82 => generated 1370 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:34:56.946860 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-83b52b11-762d-4797-b1e6-c059cf708b03 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:34:56.947691 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-83b52b11-762d-4797-b1e6-c059cf708b03 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] [instance: 6442f189-c760-45c5-8313-4f1d3fe46461] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:34:56.959386 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-83b52b11-762d-4797-b1e6-c059cf708b03 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:56.959835 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-83b52b11-762d-4797-b1e6-c059cf708b03 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:56.960634 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-83b52b11-762d-4797-b1e6-c059cf708b03 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:56.961070 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-83b52b11-762d-4797-b1e6-c059cf708b03 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:57.068232 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-83b52b11-762d-4797-b1e6-c059cf708b03 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a58f82117ab437cab5607c204c86547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4951b93f86e1485692a4aae7b9ece8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:34:57.083714 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-83b52b11-762d-4797-b1e6-c059cf708b03 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] 10.222.0.65 "GET /compute/v2.1/servers/6442f189-c760-45c5-8313-4f1d3fe46461" status: 200 len: 1145 microversion: 2.1 time: 0.140619 May 19 21:34:57.084680 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 151/310] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:34:56 2022] GET /compute/v2.1/servers/6442f189-c760-45c5-8313-4f1d3fe46461 => generated 1145 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:34:57.565185 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-13268417-7429-4128-b0c3-79a24a82e4dd tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:34:57.566561 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-13268417-7429-4128-b0c3-79a24a82e4dd tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: e51de034-1fec-4513-a375-6b28e6180d82] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:34:57.574937 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-13268417-7429-4128-b0c3-79a24a82e4dd tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:57.575729 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-13268417-7429-4128-b0c3-79a24a82e4dd tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:57.576814 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-13268417-7429-4128-b0c3-79a24a82e4dd tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:57.577472 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-13268417-7429-4128-b0c3-79a24a82e4dd tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:57.782589 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-13268417-7429-4128-b0c3-79a24a82e4dd tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1589968f375946a38e82ec484afc837f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c62c1f3c54f568abdac37360ab457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:34:57.790978 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-13268417-7429-4128-b0c3-79a24a82e4dd tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "GET /compute/v2.1/servers/e51de034-1fec-4513-a375-6b28e6180d82" status: 200 len: 1370 microversion: 2.1 time: 0.229543 May 19 21:34:57.791618 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 160/311] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:34:57 2022] GET /compute/v2.1/servers/e51de034-1fec-4513-a375-6b28e6180d82 => generated 1370 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:34:57.805105 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [req-69fd6ae0-a8d8-4651-8b1d-c1b55d0c68aa req-1eb0e412-8a27-4d34-b85c-bc77ef480ac8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e51de034-1fec-4513-a375-6b28e6180d82", "tag": "f6476118-5256-4fbe-bbbd-6fb7f8cb02c1"}]} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:34:57.819522 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-69fd6ae0-a8d8-4651-8b1d-c1b55d0c68aa req-1eb0e412-8a27-4d34-b85c-bc77ef480ac8 service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:57.819991 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-69fd6ae0-a8d8-4651-8b1d-c1b55d0c68aa req-1eb0e412-8a27-4d34-b85c-bc77ef480ac8 service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:57.841505 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.compute.server_external_events [req-69fd6ae0-a8d8-4651-8b1d-c1b55d0c68aa req-1eb0e412-8a27-4d34-b85c-bc77ef480ac8 service nova] Creating event network-changed:f6476118-5256-4fbe-bbbd-6fb7f8cb02c1 for instance e51de034-1fec-4513-a375-6b28e6180d82 on hv-cinder-83563 May 19 21:34:57.850664 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [req-69fd6ae0-a8d8-4651-8b1d-c1b55d0c68aa req-1eb0e412-8a27-4d34-b85c-bc77ef480ac8 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049503 May 19 21:34:57.855805 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 152/312] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 21:34:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 21:34:58.103029 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-ea3552fc-b17e-42e2-b066-3602f0ac43cd tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:34:58.103985 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-ea3552fc-b17e-42e2-b066-3602f0ac43cd tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] [instance: 6442f189-c760-45c5-8313-4f1d3fe46461] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:34:58.111225 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ea3552fc-b17e-42e2-b066-3602f0ac43cd tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:58.112018 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ea3552fc-b17e-42e2-b066-3602f0ac43cd tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:58.113026 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ea3552fc-b17e-42e2-b066-3602f0ac43cd tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:58.113821 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ea3552fc-b17e-42e2-b066-3602f0ac43cd tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:58.184755 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-ea3552fc-b17e-42e2-b066-3602f0ac43cd tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a58f82117ab437cab5607c204c86547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4951b93f86e1485692a4aae7b9ece8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:34:58.194277 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-ea3552fc-b17e-42e2-b066-3602f0ac43cd tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] 10.222.0.65 "GET /compute/v2.1/servers/6442f189-c760-45c5-8313-4f1d3fe46461" status: 200 len: 1145 microversion: 2.1 time: 0.094810 May 19 21:34:58.204239 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 161/313] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:34:58 2022] GET /compute/v2.1/servers/6442f189-c760-45c5-8313-4f1d3fe46461 => generated 1145 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:34:58.812238 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-c81aa1a3-9b57-4443-84d7-5cefc00ff5c4 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:34:58.819818 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-c81aa1a3-9b57-4443-84d7-5cefc00ff5c4 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: e51de034-1fec-4513-a375-6b28e6180d82] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:34:58.839181 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c81aa1a3-9b57-4443-84d7-5cefc00ff5c4 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:58.842995 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c81aa1a3-9b57-4443-84d7-5cefc00ff5c4 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:58.848294 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c81aa1a3-9b57-4443-84d7-5cefc00ff5c4 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:58.851417 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c81aa1a3-9b57-4443-84d7-5cefc00ff5c4 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:59.214078 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-2a94915b-35d1-48cc-b1f0-a04d30d799a7 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:34:59.214897 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-2a94915b-35d1-48cc-b1f0-a04d30d799a7 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] [instance: 6442f189-c760-45c5-8313-4f1d3fe46461] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:34:59.231629 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2a94915b-35d1-48cc-b1f0-a04d30d799a7 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:59.232071 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2a94915b-35d1-48cc-b1f0-a04d30d799a7 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:59.233343 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2a94915b-35d1-48cc-b1f0-a04d30d799a7 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:34:59.234014 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2a94915b-35d1-48cc-b1f0-a04d30d799a7 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:34:59.392520 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-2a94915b-35d1-48cc-b1f0-a04d30d799a7 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a58f82117ab437cab5607c204c86547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4951b93f86e1485692a4aae7b9ece8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:34:59.401862 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-2a94915b-35d1-48cc-b1f0-a04d30d799a7 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] 10.222.0.65 "GET /compute/v2.1/servers/6442f189-c760-45c5-8313-4f1d3fe46461" status: 200 len: 1201 microversion: 2.1 time: 0.192619 May 19 21:34:59.418281 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 162/314] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:34:59 2022] GET /compute/v2.1/servers/6442f189-c760-45c5-8313-4f1d3fe46461 => generated 1201 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 21:34:59.877328 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_cell0:SELECT=2 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:35:00.008519 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-c81aa1a3-9b57-4443-84d7-5cefc00ff5c4 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1589968f375946a38e82ec484afc837f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c62c1f3c54f568abdac37360ab457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:35:00.027650 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-c81aa1a3-9b57-4443-84d7-5cefc00ff5c4 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "GET /compute/v2.1/servers/e51de034-1fec-4513-a375-6b28e6180d82" status: 200 len: 1370 microversion: 2.1 time: 1.215338 May 19 21:35:00.028346 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 153/315] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:34:58 2022] GET /compute/v2.1/servers/e51de034-1fec-4513-a375-6b28e6180d82 => generated 1370 bytes in 1224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:35:00.434342 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-414c8a1c-cbbe-4053-a49a-4898542bd2ea tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:35:00.434955 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-414c8a1c-cbbe-4053-a49a-4898542bd2ea tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] [instance: 6442f189-c760-45c5-8313-4f1d3fe46461] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:35:00.452334 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-414c8a1c-cbbe-4053-a49a-4898542bd2ea tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:00.452772 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-414c8a1c-cbbe-4053-a49a-4898542bd2ea tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:00.453752 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-414c8a1c-cbbe-4053-a49a-4898542bd2ea tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:00.454360 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-414c8a1c-cbbe-4053-a49a-4898542bd2ea tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:00.607436 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-414c8a1c-cbbe-4053-a49a-4898542bd2ea tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a58f82117ab437cab5607c204c86547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4951b93f86e1485692a4aae7b9ece8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:35:00.620166 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-414c8a1c-cbbe-4053-a49a-4898542bd2ea tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] 10.222.0.65 "GET /compute/v2.1/servers/6442f189-c760-45c5-8313-4f1d3fe46461" status: 200 len: 1211 microversion: 2.1 time: 0.190891 May 19 21:35:00.634322 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 163/316] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:35:00 2022] GET /compute/v2.1/servers/6442f189-c760-45c5-8313-4f1d3fe46461 => generated 1211 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:35:01.045953 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-862457cb-8f87-4880-9a63-0e9ae73095cf tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:35:01.046633 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-862457cb-8f87-4880-9a63-0e9ae73095cf tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: e51de034-1fec-4513-a375-6b28e6180d82] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:35:01.057244 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-862457cb-8f87-4880-9a63-0e9ae73095cf tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:01.057699 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-862457cb-8f87-4880-9a63-0e9ae73095cf tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:01.063320 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-862457cb-8f87-4880-9a63-0e9ae73095cf tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:01.063764 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-862457cb-8f87-4880-9a63-0e9ae73095cf tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:01.385765 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-862457cb-8f87-4880-9a63-0e9ae73095cf tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1589968f375946a38e82ec484afc837f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c62c1f3c54f568abdac37360ab457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:35:01.403324 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-862457cb-8f87-4880-9a63-0e9ae73095cf tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "GET /compute/v2.1/servers/e51de034-1fec-4513-a375-6b28e6180d82" status: 200 len: 1370 microversion: 2.1 time: 0.361856 May 19 21:35:01.406317 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 154/317] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:35:01 2022] GET /compute/v2.1/servers/e51de034-1fec-4513-a375-6b28e6180d82 => generated 1370 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:35:01.649606 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-df265bd7-7e7d-44d4-a218-77888897d8bb tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:35:01.650162 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-df265bd7-7e7d-44d4-a218-77888897d8bb tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] [instance: 6442f189-c760-45c5-8313-4f1d3fe46461] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:35:01.667921 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-df265bd7-7e7d-44d4-a218-77888897d8bb tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:01.668388 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-df265bd7-7e7d-44d4-a218-77888897d8bb tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:01.669192 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-df265bd7-7e7d-44d4-a218-77888897d8bb tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:01.669620 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-df265bd7-7e7d-44d4-a218-77888897d8bb tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:01.972122 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-df265bd7-7e7d-44d4-a218-77888897d8bb tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a58f82117ab437cab5607c204c86547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4951b93f86e1485692a4aae7b9ece8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:35:02.027863 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-df265bd7-7e7d-44d4-a218-77888897d8bb tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] 10.222.0.65 "GET /compute/v2.1/servers/6442f189-c760-45c5-8313-4f1d3fe46461" status: 200 len: 1267 microversion: 2.1 time: 0.382056 May 19 21:35:02.028458 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 164/318] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:35:01 2022] GET /compute/v2.1/servers/6442f189-c760-45c5-8313-4f1d3fe46461 => generated 1267 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:35:02.424378 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-1c5a30a5-4392-448f-b718-568592af71f9 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:35:02.425631 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-1c5a30a5-4392-448f-b718-568592af71f9 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: e51de034-1fec-4513-a375-6b28e6180d82] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:35:02.438042 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1c5a30a5-4392-448f-b718-568592af71f9 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:02.438399 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1c5a30a5-4392-448f-b718-568592af71f9 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:02.441191 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1c5a30a5-4392-448f-b718-568592af71f9 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:02.442793 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1c5a30a5-4392-448f-b718-568592af71f9 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:03.049103 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-9f216eb9-65b6-4cb4-959e-5ffc5235503e tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:35:03.050545 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-1c5a30a5-4392-448f-b718-568592af71f9 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1589968f375946a38e82ec484afc837f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c62c1f3c54f568abdac37360ab457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:35:03.058308 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-9f216eb9-65b6-4cb4-959e-5ffc5235503e tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] [instance: 6442f189-c760-45c5-8313-4f1d3fe46461] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:35:03.059992 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-1c5a30a5-4392-448f-b718-568592af71f9 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "GET /compute/v2.1/servers/e51de034-1fec-4513-a375-6b28e6180d82" status: 200 len: 1370 microversion: 2.1 time: 0.642316 May 19 21:35:03.060707 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 155/319] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:35:02 2022] GET /compute/v2.1/servers/e51de034-1fec-4513-a375-6b28e6180d82 => generated 1370 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:35:03.071058 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9f216eb9-65b6-4cb4-959e-5ffc5235503e tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:03.073959 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9f216eb9-65b6-4cb4-959e-5ffc5235503e tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:03.093243 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9f216eb9-65b6-4cb4-959e-5ffc5235503e tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:03.096749 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9f216eb9-65b6-4cb4-959e-5ffc5235503e tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:03.363104 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [req-433a2b14-a5cf-4a0b-904e-253f1382bd11 req-350c29f8-27ed-498b-ab40-e0a203cbca17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6442f189-c760-45c5-8313-4f1d3fe46461", "tag": "2963a31a-a224-4676-b867-1f60fa8904c2"}]} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:35:03.386469 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-433a2b14-a5cf-4a0b-904e-253f1382bd11 req-350c29f8-27ed-498b-ab40-e0a203cbca17 service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:03.387536 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-433a2b14-a5cf-4a0b-904e-253f1382bd11 req-350c29f8-27ed-498b-ab40-e0a203cbca17 service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:03.424282 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.compute.server_external_events [req-433a2b14-a5cf-4a0b-904e-253f1382bd11 req-350c29f8-27ed-498b-ab40-e0a203cbca17 service nova] Creating event network-changed:2963a31a-a224-4676-b867-1f60fa8904c2 for instance 6442f189-c760-45c5-8313-4f1d3fe46461 on hv-cinder-83563 May 19 21:35:03.444663 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [req-433a2b14-a5cf-4a0b-904e-253f1382bd11 req-350c29f8-27ed-498b-ab40-e0a203cbca17 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085721 May 19 21:35:03.451392 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 156/320] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 21:35:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 21:35:03.578362 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-9f216eb9-65b6-4cb4-959e-5ffc5235503e tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a58f82117ab437cab5607c204c86547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4951b93f86e1485692a4aae7b9ece8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:35:03.596981 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-9f216eb9-65b6-4cb4-959e-5ffc5235503e tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] 10.222.0.65 "GET /compute/v2.1/servers/6442f189-c760-45c5-8313-4f1d3fe46461" status: 200 len: 1267 microversion: 2.1 time: 0.552348 May 19 21:35:03.612275 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 165/321] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:35:03 2022] GET /compute/v2.1/servers/6442f189-c760-45c5-8313-4f1d3fe46461 => generated 1267 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:35:04.080092 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-db453cfe-7b1b-456e-9e4c-0de1ebff4d27 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:35:04.081122 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-db453cfe-7b1b-456e-9e4c-0de1ebff4d27 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: e51de034-1fec-4513-a375-6b28e6180d82] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:35:04.099313 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-db453cfe-7b1b-456e-9e4c-0de1ebff4d27 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:04.100246 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-db453cfe-7b1b-456e-9e4c-0de1ebff4d27 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:04.101340 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-db453cfe-7b1b-456e-9e4c-0de1ebff4d27 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:04.101988 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-db453cfe-7b1b-456e-9e4c-0de1ebff4d27 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:04.662169 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-db453cfe-7b1b-456e-9e4c-0de1ebff4d27 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1589968f375946a38e82ec484afc837f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c62c1f3c54f568abdac37360ab457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:35:04.664226 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-1f91f349-c5af-448d-9deb-824b6de647fe tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:35:04.666182 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_cell1:SELECT=94 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:35:04.668291 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-1f91f349-c5af-448d-9deb-824b6de647fe tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] [instance: 6442f189-c760-45c5-8313-4f1d3fe46461] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:35:04.683122 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1f91f349-c5af-448d-9deb-824b6de647fe tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:04.683587 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1f91f349-c5af-448d-9deb-824b6de647fe tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:04.684390 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1f91f349-c5af-448d-9deb-824b6de647fe tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:04.684826 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1f91f349-c5af-448d-9deb-824b6de647fe tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:04.700308 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-db453cfe-7b1b-456e-9e4c-0de1ebff4d27 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "GET /compute/v2.1/servers/e51de034-1fec-4513-a375-6b28e6180d82" status: 200 len: 1370 microversion: 2.1 time: 0.625055 May 19 21:35:04.700973 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 157/322] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:35:04 2022] GET /compute/v2.1/servers/e51de034-1fec-4513-a375-6b28e6180d82 => generated 1370 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:35:05.289870 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-1f91f349-c5af-448d-9deb-824b6de647fe tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a58f82117ab437cab5607c204c86547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4951b93f86e1485692a4aae7b9ece8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:35:05.304302 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-1f91f349-c5af-448d-9deb-824b6de647fe tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] 10.222.0.65 "GET /compute/v2.1/servers/6442f189-c760-45c5-8313-4f1d3fe46461" status: 200 len: 1267 microversion: 2.1 time: 0.687785 May 19 21:35:05.306358 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 166/323] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:35:04 2022] GET /compute/v2.1/servers/6442f189-c760-45c5-8313-4f1d3fe46461 => generated 1267 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 21:35:05.724365 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-12e1459e-e152-4dbe-b872-b9118b1d26eb tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:35:05.726067 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-12e1459e-e152-4dbe-b872-b9118b1d26eb tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: e51de034-1fec-4513-a375-6b28e6180d82] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:35:05.747594 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-12e1459e-e152-4dbe-b872-b9118b1d26eb tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:05.756588 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-12e1459e-e152-4dbe-b872-b9118b1d26eb tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:05.760146 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-12e1459e-e152-4dbe-b872-b9118b1d26eb tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:05.760895 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-12e1459e-e152-4dbe-b872-b9118b1d26eb tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:05.923619 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_cell0:SELECT=8 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:35:06.063358 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-12e1459e-e152-4dbe-b872-b9118b1d26eb tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1589968f375946a38e82ec484afc837f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c62c1f3c54f568abdac37360ab457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:35:06.073928 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-12e1459e-e152-4dbe-b872-b9118b1d26eb tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "GET /compute/v2.1/servers/e51de034-1fec-4513-a375-6b28e6180d82" status: 200 len: 1370 microversion: 2.1 time: 0.357092 May 19 21:35:06.075174 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 158/324] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:35:05 2022] GET /compute/v2.1/servers/e51de034-1fec-4513-a375-6b28e6180d82 => generated 1370 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:35:06.346533 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-3ce3697b-eff6-4313-9df0-9aa75b75bea6 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:35:06.347686 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-3ce3697b-eff6-4313-9df0-9aa75b75bea6 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] [instance: 6442f189-c760-45c5-8313-4f1d3fe46461] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:35:06.372877 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell0:SELECT=2 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:35:06.374645 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell0:SELECT=12 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:35:06.381603 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3ce3697b-eff6-4313-9df0-9aa75b75bea6 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:06.387322 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3ce3697b-eff6-4313-9df0-9aa75b75bea6 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:06.392098 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3ce3697b-eff6-4313-9df0-9aa75b75bea6 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:06.393255 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3ce3697b-eff6-4313-9df0-9aa75b75bea6 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:06.408821 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell1:SELECT=98 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:35:06.576000 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-2b51e2b9-dba8-468c-8802-82dbc2b020c7 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Action: 'create', calling method: .version_select at 0x7fe3680059d0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1602403806", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJP/5SbYyp20WWNJnWLze096QTdgbxVH8lJICkT17npuH9Iu+V+caG+TJpbcWo3hzdadqDowrLMbgX556YzuYZH312XFv8dMmSm3fwX+lLkKAWniyIvQHdArQVhR2vodsQ=="}} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:35:06.634001 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.quota [None req-2b51e2b9-dba8-468c-8802-82dbc2b020c7 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Getting quotas for project 3fcf03712c6f4926a2a95dfd0519536a. Resources: {'key_pairs'} {{(pid=124349) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 21:35:06.645165 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.quota [None req-2b51e2b9-dba8-468c-8802-82dbc2b020c7 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Getting quotas for user 1664dba0cd9b4d9da1e4b78691b8567e and project 3fcf03712c6f4926a2a95dfd0519536a. Resources: {'key_pairs'} {{(pid=124349) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 21:35:06.710195 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-2b51e2b9-dba8-468c-8802-82dbc2b020c7 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.139417 May 19 21:35:06.711687 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 159/325] 10.222.0.65 () {60 vars in 1158 bytes} [Thu May 19 21:35:06 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 21:35:06.803737 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-3ce3697b-eff6-4313-9df0-9aa75b75bea6 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a58f82117ab437cab5607c204c86547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4951b93f86e1485692a4aae7b9ece8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:35:06.813575 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-3ce3697b-eff6-4313-9df0-9aa75b75bea6 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] 10.222.0.65 "GET /compute/v2.1/servers/6442f189-c760-45c5-8313-4f1d3fe46461" status: 200 len: 1267 microversion: 2.1 time: 0.472961 May 19 21:35:06.826266 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 167/326] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:35:06 2022] GET /compute/v2.1/servers/6442f189-c760-45c5-8313-4f1d3fe46461 => generated 1267 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:35:06.989951 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-a03b4636-9ce6-4925-a6a6-b63b95f0b7e0 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-765299401", "imageRef": "5d6b5a47-4aa7-424e-9e30-74c733adaea4", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1602403806", "networks": [{"uuid": "6cd75369-7235-4ef1-aaac-030ca2e9ad5c"}]}} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:35:07.105095 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.network.neutron [None req-a03b4636-9ce6-4925-a6a6-b63b95f0b7e0 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] validate_networks() for [('6cd75369-7235-4ef1-aaac-030ca2e9ad5c', None, None, None, None, None)] {{(pid=124349) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 19 21:35:07.117866 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-e9cec4b1-6398-4642-af75-a349924b3044 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:35:07.118527 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-e9cec4b1-6398-4642-af75-a349924b3044 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: e51de034-1fec-4513-a375-6b28e6180d82] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:35:07.126219 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e9cec4b1-6398-4642-af75-a349924b3044 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:07.126693 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e9cec4b1-6398-4642-af75-a349924b3044 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:07.127487 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e9cec4b1-6398-4642-af75-a349924b3044 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:07.127920 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e9cec4b1-6398-4642-af75-a349924b3044 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:07.386399 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-e9cec4b1-6398-4642-af75-a349924b3044 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1589968f375946a38e82ec484afc837f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c62c1f3c54f568abdac37360ab457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:35:07.395287 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-e9cec4b1-6398-4642-af75-a349924b3044 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "GET /compute/v2.1/servers/e51de034-1fec-4513-a375-6b28e6180d82" status: 200 len: 1370 microversion: 2.1 time: 0.305293 May 19 21:35:07.398228 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 168/327] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:35:07 2022] GET /compute/v2.1/servers/e51de034-1fec-4513-a375-6b28e6180d82 => generated 1370 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 21:35:07.760117 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.virt.hardware [None req-a03b4636-9ce6-4925-a6a6-b63b95f0b7e0 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Flavor limits 0:0:0 {{(pid=124349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 21:35:07.760619 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.virt.hardware [None req-a03b4636-9ce6-4925-a6a6-b63b95f0b7e0 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Image limits 0:0:0 {{(pid=124349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 21:35:07.761180 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.virt.hardware [None req-a03b4636-9ce6-4925-a6a6-b63b95f0b7e0 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Flavor pref 0:0:0 {{(pid=124349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 21:35:07.761991 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.virt.hardware [None req-a03b4636-9ce6-4925-a6a6-b63b95f0b7e0 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Image pref 0:0:0 {{(pid=124349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 21:35:07.764621 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.virt.hardware [None req-a03b4636-9ce6-4925-a6a6-b63b95f0b7e0 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 21:35:07.783323 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a03b4636-9ce6-4925-a6a6-b63b95f0b7e0 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:07.784929 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a03b4636-9ce6-4925-a6a6-b63b95f0b7e0 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:07.786627 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a03b4636-9ce6-4925-a6a6-b63b95f0b7e0 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:07.787597 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a03b4636-9ce6-4925-a6a6-b63b95f0b7e0 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:07.845449 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-3c73a795-77e4-47eb-999a-f1f9460fa2ac tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:35:07.846390 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-3c73a795-77e4-47eb-999a-f1f9460fa2ac tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] [instance: 6442f189-c760-45c5-8313-4f1d3fe46461] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:35:07.851227 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.quota [None req-a03b4636-9ce6-4925-a6a6-b63b95f0b7e0 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Getting quotas for project 3fcf03712c6f4926a2a95dfd0519536a. Resources: {'ram', 'cores', 'instances'} {{(pid=124349) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 21:35:07.857602 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3c73a795-77e4-47eb-999a-f1f9460fa2ac tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:07.860372 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3c73a795-77e4-47eb-999a-f1f9460fa2ac tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:07.861424 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3c73a795-77e4-47eb-999a-f1f9460fa2ac tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:07.862283 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.quota [None req-a03b4636-9ce6-4925-a6a6-b63b95f0b7e0 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Getting quotas for user 1664dba0cd9b4d9da1e4b78691b8567e and project 3fcf03712c6f4926a2a95dfd0519536a. Resources: {'ram', 'cores', 'instances'} {{(pid=124349) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 21:35:07.862513 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3c73a795-77e4-47eb-999a-f1f9460fa2ac tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:07.894605 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-a03b4636-9ce6-4925-a6a6-b63b95f0b7e0 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Going to run 1 instances... {{(pid=124349) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 21:35:07.900436 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-a03b4636-9ce6-4925-a6a6-b63b95f0b7e0 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] [instance: 89cb2230-d75e-4c8c-b47b-83f1698654dd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5d6b5a47-4aa7-424e-9e30-74c733adaea4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124349) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 21:35:08.064792 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-a03b4636-9ce6-4925-a6a6-b63b95f0b7e0 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.078860 May 19 21:35:08.070470 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 160/328] 10.222.0.65 () {60 vars in 1146 bytes} [Thu May 19 21:35:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1081 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 21:35:08.075433 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-3f98f099-0f0c-4694-9111-5a66d02874ff tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:35:08.076377 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-3f98f099-0f0c-4694-9111-5a66d02874ff tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] [instance: 89cb2230-d75e-4c8c-b47b-83f1698654dd] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:35:08.277835 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-3f98f099-0f0c-4694-9111-5a66d02874ff tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1664dba0cd9b4d9da1e4b78691b8567e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fcf03712c6f4926a2a95dfd0519536a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:35:08.297945 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-3f98f099-0f0c-4694-9111-5a66d02874ff tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] 10.222.0.65 "GET /compute/v2.1/servers/89cb2230-d75e-4c8c-b47b-83f1698654dd" status: 200 len: 1258 microversion: 2.1 time: 0.226414 May 19 21:35:08.298831 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 161/329] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:35:08 2022] GET /compute/v2.1/servers/89cb2230-d75e-4c8c-b47b-83f1698654dd => generated 1258 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 21:35:08.309009 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-3c73a795-77e4-47eb-999a-f1f9460fa2ac tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a58f82117ab437cab5607c204c86547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4951b93f86e1485692a4aae7b9ece8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:35:08.322153 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-3c73a795-77e4-47eb-999a-f1f9460fa2ac tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] 10.222.0.65 "GET /compute/v2.1/servers/6442f189-c760-45c5-8313-4f1d3fe46461" status: 200 len: 1267 microversion: 2.1 time: 0.481727 May 19 21:35:08.322801 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 169/330] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:35:07 2022] GET /compute/v2.1/servers/6442f189-c760-45c5-8313-4f1d3fe46461 => generated 1267 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 21:35:08.416810 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-cc4dbfee-b3b2-425c-bf40-54f43763e1cb tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:35:08.417335 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-cc4dbfee-b3b2-425c-bf40-54f43763e1cb tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: e51de034-1fec-4513-a375-6b28e6180d82] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:35:08.433964 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-cc4dbfee-b3b2-425c-bf40-54f43763e1cb tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:08.434440 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-cc4dbfee-b3b2-425c-bf40-54f43763e1cb tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:08.435266 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-cc4dbfee-b3b2-425c-bf40-54f43763e1cb tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:08.435892 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-cc4dbfee-b3b2-425c-bf40-54f43763e1cb tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:08.760608 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-cc4dbfee-b3b2-425c-bf40-54f43763e1cb tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1589968f375946a38e82ec484afc837f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c62c1f3c54f568abdac37360ab457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:35:08.776218 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-cc4dbfee-b3b2-425c-bf40-54f43763e1cb tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "GET /compute/v2.1/servers/e51de034-1fec-4513-a375-6b28e6180d82" status: 200 len: 1370 microversion: 2.1 time: 0.363680 May 19 21:35:08.776797 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 162/331] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:35:08 2022] GET /compute/v2.1/servers/e51de034-1fec-4513-a375-6b28e6180d82 => generated 1370 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:35:09.320356 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-88e2f648-ab5d-447c-b140-3f6c4aef2cd1 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:35:09.322458 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-88e2f648-ab5d-447c-b140-3f6c4aef2cd1 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] [instance: 89cb2230-d75e-4c8c-b47b-83f1698654dd] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:35:09.335716 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-88e2f648-ab5d-447c-b140-3f6c4aef2cd1 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:09.337025 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-88e2f648-ab5d-447c-b140-3f6c4aef2cd1 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:09.338746 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-88e2f648-ab5d-447c-b140-3f6c4aef2cd1 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:09.339787 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-7c635576-b06a-4596-ad0b-5c5a3e807b17 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:35:09.340944 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-7c635576-b06a-4596-ad0b-5c5a3e807b17 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] [instance: 6442f189-c760-45c5-8313-4f1d3fe46461] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:35:09.341273 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-88e2f648-ab5d-447c-b140-3f6c4aef2cd1 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:09.356046 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-7c635576-b06a-4596-ad0b-5c5a3e807b17 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:09.356478 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-7c635576-b06a-4596-ad0b-5c5a3e807b17 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:09.359255 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-7c635576-b06a-4596-ad0b-5c5a3e807b17 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:09.360171 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-7c635576-b06a-4596-ad0b-5c5a3e807b17 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:09.466647 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-88e2f648-ab5d-447c-b140-3f6c4aef2cd1 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1664dba0cd9b4d9da1e4b78691b8567e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fcf03712c6f4926a2a95dfd0519536a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:35:09.478165 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-88e2f648-ab5d-447c-b140-3f6c4aef2cd1 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] 10.222.0.65 "GET /compute/v2.1/servers/89cb2230-d75e-4c8c-b47b-83f1698654dd" status: 200 len: 1262 microversion: 2.1 time: 0.165099 May 19 21:35:09.479722 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 170/332] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:35:09 2022] GET /compute/v2.1/servers/89cb2230-d75e-4c8c-b47b-83f1698654dd => generated 1262 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:35:09.552488 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-7c635576-b06a-4596-ad0b-5c5a3e807b17 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a58f82117ab437cab5607c204c86547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4951b93f86e1485692a4aae7b9ece8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:35:09.563754 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-7c635576-b06a-4596-ad0b-5c5a3e807b17 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] 10.222.0.65 "GET /compute/v2.1/servers/6442f189-c760-45c5-8313-4f1d3fe46461" status: 200 len: 1267 microversion: 2.1 time: 0.227395 May 19 21:35:09.564591 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 163/333] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:35:09 2022] GET /compute/v2.1/servers/6442f189-c760-45c5-8313-4f1d3fe46461 => generated 1267 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 21:35:09.830009 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-046840bc-eb10-4e49-a6da-2992a5f85d89 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:35:09.836969 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-046840bc-eb10-4e49-a6da-2992a5f85d89 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: e51de034-1fec-4513-a375-6b28e6180d82] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:35:09.904967 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-046840bc-eb10-4e49-a6da-2992a5f85d89 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:09.905358 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-046840bc-eb10-4e49-a6da-2992a5f85d89 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:09.913634 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-046840bc-eb10-4e49-a6da-2992a5f85d89 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:09.917572 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-046840bc-eb10-4e49-a6da-2992a5f85d89 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:10.112794 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-046840bc-eb10-4e49-a6da-2992a5f85d89 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1589968f375946a38e82ec484afc837f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c62c1f3c54f568abdac37360ab457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:35:10.123885 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-046840bc-eb10-4e49-a6da-2992a5f85d89 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "GET /compute/v2.1/servers/e51de034-1fec-4513-a375-6b28e6180d82" status: 200 len: 1370 microversion: 2.1 time: 0.330588 May 19 21:35:10.135073 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 171/334] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:35:09 2022] GET /compute/v2.1/servers/e51de034-1fec-4513-a375-6b28e6180d82 => generated 1370 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:35:10.506791 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-e6242419-de49-4a65-a221-6a1379ad0122 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:35:10.507506 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-e6242419-de49-4a65-a221-6a1379ad0122 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] [instance: 89cb2230-d75e-4c8c-b47b-83f1698654dd] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:35:10.517155 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e6242419-de49-4a65-a221-6a1379ad0122 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:10.517631 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e6242419-de49-4a65-a221-6a1379ad0122 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:10.518480 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e6242419-de49-4a65-a221-6a1379ad0122 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:10.538459 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e6242419-de49-4a65-a221-6a1379ad0122 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:10.586045 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-2f035414-3a25-4fa2-8429-e32b45c603db tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:35:10.586883 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-2f035414-3a25-4fa2-8429-e32b45c603db tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] [instance: 6442f189-c760-45c5-8313-4f1d3fe46461] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:35:10.598044 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-e6242419-de49-4a65-a221-6a1379ad0122 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1664dba0cd9b4d9da1e4b78691b8567e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fcf03712c6f4926a2a95dfd0519536a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:35:10.607200 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=4 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:35:10.609961 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-e6242419-de49-4a65-a221-6a1379ad0122 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] 10.222.0.65 "GET /compute/v2.1/servers/89cb2230-d75e-4c8c-b47b-83f1698654dd" status: 200 len: 1262 microversion: 2.1 time: 0.109414 May 19 21:35:10.610593 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 164/335] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:35:10 2022] GET /compute/v2.1/servers/89cb2230-d75e-4c8c-b47b-83f1698654dd => generated 1262 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:35:10.634342 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2f035414-3a25-4fa2-8429-e32b45c603db tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:10.635152 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2f035414-3a25-4fa2-8429-e32b45c603db tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:10.636600 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2f035414-3a25-4fa2-8429-e32b45c603db tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:10.637386 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2f035414-3a25-4fa2-8429-e32b45c603db tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:10.855312 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-2f035414-3a25-4fa2-8429-e32b45c603db tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a58f82117ab437cab5607c204c86547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4951b93f86e1485692a4aae7b9ece8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:35:10.878010 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-2f035414-3a25-4fa2-8429-e32b45c603db tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] 10.222.0.65 "GET /compute/v2.1/servers/6442f189-c760-45c5-8313-4f1d3fe46461" status: 200 len: 1267 microversion: 2.1 time: 0.298479 May 19 21:35:10.881067 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 172/336] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:35:10 2022] GET /compute/v2.1/servers/6442f189-c760-45c5-8313-4f1d3fe46461 => generated 1267 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:35:11.141597 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-dcfbb644-d8ec-4d35-bf96-0a99b3cced86 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:35:11.142497 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-dcfbb644-d8ec-4d35-bf96-0a99b3cced86 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: e51de034-1fec-4513-a375-6b28e6180d82] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:35:11.150268 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-dcfbb644-d8ec-4d35-bf96-0a99b3cced86 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:11.150722 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-dcfbb644-d8ec-4d35-bf96-0a99b3cced86 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:11.151498 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-dcfbb644-d8ec-4d35-bf96-0a99b3cced86 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:11.152125 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-dcfbb644-d8ec-4d35-bf96-0a99b3cced86 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:11.372089 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-dcfbb644-d8ec-4d35-bf96-0a99b3cced86 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1589968f375946a38e82ec484afc837f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c62c1f3c54f568abdac37360ab457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:35:11.381030 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-dcfbb644-d8ec-4d35-bf96-0a99b3cced86 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "GET /compute/v2.1/servers/e51de034-1fec-4513-a375-6b28e6180d82" status: 200 len: 1370 microversion: 2.1 time: 0.243393 May 19 21:35:11.381689 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 165/337] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:35:11 2022] GET /compute/v2.1/servers/e51de034-1fec-4513-a375-6b28e6180d82 => generated 1370 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:35:11.640919 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-c447def0-20e6-4d42-b692-46c82713d4b4 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:35:11.641792 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-c447def0-20e6-4d42-b692-46c82713d4b4 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] [instance: 89cb2230-d75e-4c8c-b47b-83f1698654dd] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:35:11.649704 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c447def0-20e6-4d42-b692-46c82713d4b4 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:11.650164 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c447def0-20e6-4d42-b692-46c82713d4b4 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:11.650970 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c447def0-20e6-4d42-b692-46c82713d4b4 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:11.651402 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c447def0-20e6-4d42-b692-46c82713d4b4 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:11.752909 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-c447def0-20e6-4d42-b692-46c82713d4b4 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1664dba0cd9b4d9da1e4b78691b8567e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fcf03712c6f4926a2a95dfd0519536a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:35:11.764184 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-c447def0-20e6-4d42-b692-46c82713d4b4 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] 10.222.0.65 "GET /compute/v2.1/servers/89cb2230-d75e-4c8c-b47b-83f1698654dd" status: 200 len: 1262 microversion: 2.1 time: 0.128066 May 19 21:35:11.764764 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 173/338] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:35:11 2022] GET /compute/v2.1/servers/89cb2230-d75e-4c8c-b47b-83f1698654dd => generated 1262 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:35:11.903167 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-d42d9b79-c29d-4709-b230-d2c5556c7aee tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:35:11.906359 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-d42d9b79-c29d-4709-b230-d2c5556c7aee tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] [instance: 6442f189-c760-45c5-8313-4f1d3fe46461] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:35:11.928572 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-d42d9b79-c29d-4709-b230-d2c5556c7aee tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:11.936818 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-d42d9b79-c29d-4709-b230-d2c5556c7aee tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:11.939409 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-d42d9b79-c29d-4709-b230-d2c5556c7aee tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:11.946579 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-d42d9b79-c29d-4709-b230-d2c5556c7aee tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:12.197921 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-d42d9b79-c29d-4709-b230-d2c5556c7aee tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a58f82117ab437cab5607c204c86547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4951b93f86e1485692a4aae7b9ece8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:35:12.238475 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-d42d9b79-c29d-4709-b230-d2c5556c7aee tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] 10.222.0.65 "GET /compute/v2.1/servers/6442f189-c760-45c5-8313-4f1d3fe46461" status: 200 len: 1267 microversion: 2.1 time: 0.341989 May 19 21:35:12.239403 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 166/339] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:35:11 2022] GET /compute/v2.1/servers/6442f189-c760-45c5-8313-4f1d3fe46461 => generated 1267 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 21:35:12.400440 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-a33c65f2-692a-404d-961d-5d0c96722eca tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:35:12.401595 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-a33c65f2-692a-404d-961d-5d0c96722eca tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: e51de034-1fec-4513-a375-6b28e6180d82] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:35:12.412716 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a33c65f2-692a-404d-961d-5d0c96722eca tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:12.413475 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a33c65f2-692a-404d-961d-5d0c96722eca tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:12.414473 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a33c65f2-692a-404d-961d-5d0c96722eca tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:12.415121 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a33c65f2-692a-404d-961d-5d0c96722eca tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:12.652570 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-a33c65f2-692a-404d-961d-5d0c96722eca tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1589968f375946a38e82ec484afc837f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c62c1f3c54f568abdac37360ab457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:35:12.667494 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-a33c65f2-692a-404d-961d-5d0c96722eca tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "GET /compute/v2.1/servers/e51de034-1fec-4513-a375-6b28e6180d82" status: 200 len: 1370 microversion: 2.1 time: 0.272162 May 19 21:35:12.683881 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 174/340] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:35:12 2022] GET /compute/v2.1/servers/e51de034-1fec-4513-a375-6b28e6180d82 => generated 1370 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:35:12.787495 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-560e3fad-65d3-433e-9fae-dc5b97f05df4 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:35:12.788607 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-560e3fad-65d3-433e-9fae-dc5b97f05df4 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] [instance: 89cb2230-d75e-4c8c-b47b-83f1698654dd] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:35:12.801552 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-560e3fad-65d3-433e-9fae-dc5b97f05df4 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:12.802701 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-560e3fad-65d3-433e-9fae-dc5b97f05df4 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:12.804976 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-560e3fad-65d3-433e-9fae-dc5b97f05df4 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:12.808154 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-560e3fad-65d3-433e-9fae-dc5b97f05df4 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:12.912397 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-560e3fad-65d3-433e-9fae-dc5b97f05df4 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1664dba0cd9b4d9da1e4b78691b8567e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fcf03712c6f4926a2a95dfd0519536a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:35:12.925382 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-560e3fad-65d3-433e-9fae-dc5b97f05df4 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] 10.222.0.65 "GET /compute/v2.1/servers/89cb2230-d75e-4c8c-b47b-83f1698654dd" status: 200 len: 1262 microversion: 2.1 time: 0.145046 May 19 21:35:12.925960 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 167/341] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:35:12 2022] GET /compute/v2.1/servers/89cb2230-d75e-4c8c-b47b-83f1698654dd => generated 1262 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:35:13.269248 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-ccb5b0a2-4422-4f4a-9aea-cfe6250a8637 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:35:13.270636 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-ccb5b0a2-4422-4f4a-9aea-cfe6250a8637 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] [instance: 6442f189-c760-45c5-8313-4f1d3fe46461] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:35:13.293061 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ccb5b0a2-4422-4f4a-9aea-cfe6250a8637 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:13.294364 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ccb5b0a2-4422-4f4a-9aea-cfe6250a8637 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:13.296276 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ccb5b0a2-4422-4f4a-9aea-cfe6250a8637 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:13.296892 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ccb5b0a2-4422-4f4a-9aea-cfe6250a8637 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:13.626620 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-ccb5b0a2-4422-4f4a-9aea-cfe6250a8637 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a58f82117ab437cab5607c204c86547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4951b93f86e1485692a4aae7b9ece8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:35:13.646777 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-ccb5b0a2-4422-4f4a-9aea-cfe6250a8637 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] 10.222.0.65 "GET /compute/v2.1/servers/6442f189-c760-45c5-8313-4f1d3fe46461" status: 200 len: 1267 microversion: 2.1 time: 0.383887 May 19 21:35:13.666782 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 175/342] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:35:13 2022] GET /compute/v2.1/servers/6442f189-c760-45c5-8313-4f1d3fe46461 => generated 1267 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:35:13.689137 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-b85d661c-048f-4582-9358-2478f180ccc4 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:35:13.689971 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-b85d661c-048f-4582-9358-2478f180ccc4 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: e51de034-1fec-4513-a375-6b28e6180d82] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:35:13.699143 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-b85d661c-048f-4582-9358-2478f180ccc4 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:13.701980 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-b85d661c-048f-4582-9358-2478f180ccc4 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:13.703198 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-b85d661c-048f-4582-9358-2478f180ccc4 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:13.703757 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-b85d661c-048f-4582-9358-2478f180ccc4 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:13.946482 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-e21849c5-bcdc-4933-9f9b-7647f4cd6dae tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:35:13.947496 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-e21849c5-bcdc-4933-9f9b-7647f4cd6dae tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] [instance: 89cb2230-d75e-4c8c-b47b-83f1698654dd] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:35:13.976444 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e21849c5-bcdc-4933-9f9b-7647f4cd6dae tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:13.977339 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e21849c5-bcdc-4933-9f9b-7647f4cd6dae tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:13.979905 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e21849c5-bcdc-4933-9f9b-7647f4cd6dae tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:13.981550 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e21849c5-bcdc-4933-9f9b-7647f4cd6dae tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:14.086810 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-e21849c5-bcdc-4933-9f9b-7647f4cd6dae tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1664dba0cd9b4d9da1e4b78691b8567e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fcf03712c6f4926a2a95dfd0519536a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:35:14.097326 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-e21849c5-bcdc-4933-9f9b-7647f4cd6dae tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] 10.222.0.65 "GET /compute/v2.1/servers/89cb2230-d75e-4c8c-b47b-83f1698654dd" status: 200 len: 1310 microversion: 2.1 time: 0.156045 May 19 21:35:14.099014 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 176/343] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:35:13 2022] GET /compute/v2.1/servers/89cb2230-d75e-4c8c-b47b-83f1698654dd => generated 1310 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:35:14.308727 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-b85d661c-048f-4582-9358-2478f180ccc4 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1589968f375946a38e82ec484afc837f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c62c1f3c54f568abdac37360ab457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:35:14.369254 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-b85d661c-048f-4582-9358-2478f180ccc4 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "GET /compute/v2.1/servers/e51de034-1fec-4513-a375-6b28e6180d82" status: 200 len: 1370 microversion: 2.1 time: 0.684723 May 19 21:35:14.369864 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 168/344] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:35:13 2022] GET /compute/v2.1/servers/e51de034-1fec-4513-a375-6b28e6180d82 => generated 1370 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:35:14.485667 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [req-6f3e2e66-0ec2-4919-a2f3-4a3d560c2c69 req-3f8396c5-fd38-4d3b-a704-1cd7dad6f0ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e51de034-1fec-4513-a375-6b28e6180d82", "name": "network-vif-plugged", "status": "completed", "tag": "f6476118-5256-4fbe-bbbd-6fb7f8cb02c1"}]} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:35:14.509635 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-6f3e2e66-0ec2-4919-a2f3-4a3d560c2c69 req-3f8396c5-fd38-4d3b-a704-1cd7dad6f0ad service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:14.510891 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-6f3e2e66-0ec2-4919-a2f3-4a3d560c2c69 req-3f8396c5-fd38-4d3b-a704-1cd7dad6f0ad service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:14.537174 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.compute.server_external_events [req-6f3e2e66-0ec2-4919-a2f3-4a3d560c2c69 req-3f8396c5-fd38-4d3b-a704-1cd7dad6f0ad service nova] Creating event network-vif-plugged:f6476118-5256-4fbe-bbbd-6fb7f8cb02c1 for instance e51de034-1fec-4513-a375-6b28e6180d82 on hv-cinder-83563 May 19 21:35:14.545488 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [req-6f3e2e66-0ec2-4919-a2f3-4a3d560c2c69 req-3f8396c5-fd38-4d3b-a704-1cd7dad6f0ad service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066057 May 19 21:35:14.547067 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 177/345] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 21:35:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 21:35:14.676028 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-4402a753-5d10-4681-8be1-f694c671c94f tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:35:14.676995 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-4402a753-5d10-4681-8be1-f694c671c94f tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] [instance: 6442f189-c760-45c5-8313-4f1d3fe46461] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:35:14.694832 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-4402a753-5d10-4681-8be1-f694c671c94f tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:14.696078 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-4402a753-5d10-4681-8be1-f694c671c94f tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:14.696918 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-4402a753-5d10-4681-8be1-f694c671c94f tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:14.697384 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-4402a753-5d10-4681-8be1-f694c671c94f tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:15.073831 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-4402a753-5d10-4681-8be1-f694c671c94f tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a58f82117ab437cab5607c204c86547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4951b93f86e1485692a4aae7b9ece8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:35:15.083212 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-4402a753-5d10-4681-8be1-f694c671c94f tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] 10.222.0.65 "GET /compute/v2.1/servers/6442f189-c760-45c5-8313-4f1d3fe46461" status: 200 len: 1267 microversion: 2.1 time: 0.413052 May 19 21:35:15.086272 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 169/346] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:35:14 2022] GET /compute/v2.1/servers/6442f189-c760-45c5-8313-4f1d3fe46461 => generated 1267 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:35:15.130455 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-04544a65-5f5c-4309-b76c-e018a825ccd7 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:35:15.131158 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-04544a65-5f5c-4309-b76c-e018a825ccd7 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] [instance: 89cb2230-d75e-4c8c-b47b-83f1698654dd] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:35:15.148023 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-04544a65-5f5c-4309-b76c-e018a825ccd7 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:15.148469 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-04544a65-5f5c-4309-b76c-e018a825ccd7 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:15.156385 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-04544a65-5f5c-4309-b76c-e018a825ccd7 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:15.157000 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-04544a65-5f5c-4309-b76c-e018a825ccd7 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:15.270060 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-04544a65-5f5c-4309-b76c-e018a825ccd7 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1664dba0cd9b4d9da1e4b78691b8567e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fcf03712c6f4926a2a95dfd0519536a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:35:15.281076 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-04544a65-5f5c-4309-b76c-e018a825ccd7 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] 10.222.0.65 "GET /compute/v2.1/servers/89cb2230-d75e-4c8c-b47b-83f1698654dd" status: 200 len: 1316 microversion: 2.1 time: 0.156033 May 19 21:35:15.290304 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 178/347] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:35:15 2022] GET /compute/v2.1/servers/89cb2230-d75e-4c8c-b47b-83f1698654dd => generated 1316 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 21:35:15.388686 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-ea634c80-dc14-48a4-9f18-35edecf2f131 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:35:15.389649 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-ea634c80-dc14-48a4-9f18-35edecf2f131 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: e51de034-1fec-4513-a375-6b28e6180d82] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:35:15.397590 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ea634c80-dc14-48a4-9f18-35edecf2f131 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:15.398092 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ea634c80-dc14-48a4-9f18-35edecf2f131 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:15.398981 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ea634c80-dc14-48a4-9f18-35edecf2f131 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:15.399694 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ea634c80-dc14-48a4-9f18-35edecf2f131 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:15.844923 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-ea634c80-dc14-48a4-9f18-35edecf2f131 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1589968f375946a38e82ec484afc837f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c62c1f3c54f568abdac37360ab457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:35:15.860151 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-ea634c80-dc14-48a4-9f18-35edecf2f131 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "GET /compute/v2.1/servers/e51de034-1fec-4513-a375-6b28e6180d82" status: 200 len: 1370 microversion: 2.1 time: 0.475953 May 19 21:35:15.861263 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 170/348] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:35:15 2022] GET /compute/v2.1/servers/e51de034-1fec-4513-a375-6b28e6180d82 => generated 1370 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 21:35:16.101085 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-33669fac-31ad-4a97-ae0e-0249a238b273 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:35:16.102210 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-33669fac-31ad-4a97-ae0e-0249a238b273 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] [instance: 6442f189-c760-45c5-8313-4f1d3fe46461] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:35:16.114617 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-33669fac-31ad-4a97-ae0e-0249a238b273 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:16.115629 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-33669fac-31ad-4a97-ae0e-0249a238b273 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:16.116673 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-33669fac-31ad-4a97-ae0e-0249a238b273 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:16.117330 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-33669fac-31ad-4a97-ae0e-0249a238b273 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:16.303742 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-ea1c9557-4229-4b28-b913-6688badb9809 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:35:16.305251 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-ea1c9557-4229-4b28-b913-6688badb9809 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] [instance: 89cb2230-d75e-4c8c-b47b-83f1698654dd] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:35:16.319861 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ea1c9557-4229-4b28-b913-6688badb9809 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:16.320772 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ea1c9557-4229-4b28-b913-6688badb9809 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:16.321607 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ea1c9557-4229-4b28-b913-6688badb9809 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:16.324921 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ea1c9557-4229-4b28-b913-6688badb9809 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:16.525840 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-ea1c9557-4229-4b28-b913-6688badb9809 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1664dba0cd9b4d9da1e4b78691b8567e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fcf03712c6f4926a2a95dfd0519536a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:35:16.534409 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-ea1c9557-4229-4b28-b913-6688badb9809 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] 10.222.0.65 "GET /compute/v2.1/servers/89cb2230-d75e-4c8c-b47b-83f1698654dd" status: 200 len: 1316 microversion: 2.1 time: 0.235910 May 19 21:35:16.540461 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 171/349] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:35:16 2022] GET /compute/v2.1/servers/89cb2230-d75e-4c8c-b47b-83f1698654dd => generated 1316 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 21:35:16.625024 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-33669fac-31ad-4a97-ae0e-0249a238b273 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a58f82117ab437cab5607c204c86547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4951b93f86e1485692a4aae7b9ece8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:35:16.713934 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-33669fac-31ad-4a97-ae0e-0249a238b273 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] 10.222.0.65 "GET /compute/v2.1/servers/6442f189-c760-45c5-8313-4f1d3fe46461" status: 200 len: 1267 microversion: 2.1 time: 0.599031 May 19 21:35:16.714857 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 179/350] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:35:16 2022] GET /compute/v2.1/servers/6442f189-c760-45c5-8313-4f1d3fe46461 => generated 1267 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 21:35:16.887478 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-12c6ff09-89f6-4c07-a54a-e719081c03a7 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:35:16.888212 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-12c6ff09-89f6-4c07-a54a-e719081c03a7 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: e51de034-1fec-4513-a375-6b28e6180d82] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:35:16.897999 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-12c6ff09-89f6-4c07-a54a-e719081c03a7 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:16.905415 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-12c6ff09-89f6-4c07-a54a-e719081c03a7 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:16.906490 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-12c6ff09-89f6-4c07-a54a-e719081c03a7 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:16.907097 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-12c6ff09-89f6-4c07-a54a-e719081c03a7 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:17.272319 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-12c6ff09-89f6-4c07-a54a-e719081c03a7 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1589968f375946a38e82ec484afc837f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c62c1f3c54f568abdac37360ab457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:35:17.317628 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-12c6ff09-89f6-4c07-a54a-e719081c03a7 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "GET /compute/v2.1/servers/e51de034-1fec-4513-a375-6b28e6180d82" status: 200 len: 1370 microversion: 2.1 time: 0.433944 May 19 21:35:17.323257 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 172/351] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:35:16 2022] GET /compute/v2.1/servers/e51de034-1fec-4513-a375-6b28e6180d82 => generated 1370 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 21:35:17.560417 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-f7d13ab6-76e3-48ac-a587-4db43e7c985c tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:35:17.562080 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-f7d13ab6-76e3-48ac-a587-4db43e7c985c tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] [instance: 89cb2230-d75e-4c8c-b47b-83f1698654dd] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:35:17.577581 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f7d13ab6-76e3-48ac-a587-4db43e7c985c tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:17.581940 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f7d13ab6-76e3-48ac-a587-4db43e7c985c tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:17.583690 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f7d13ab6-76e3-48ac-a587-4db43e7c985c tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:17.587384 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f7d13ab6-76e3-48ac-a587-4db43e7c985c tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:17.763425 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-7c2d2db3-1ac3-4ded-badf-900bd441bbfa tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:35:17.782842 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-7c2d2db3-1ac3-4ded-badf-900bd441bbfa tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] [instance: 6442f189-c760-45c5-8313-4f1d3fe46461] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:35:17.831363 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_cell0:SELECT=2 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:35:17.851583 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-7c2d2db3-1ac3-4ded-badf-900bd441bbfa tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:17.853007 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-7c2d2db3-1ac3-4ded-badf-900bd441bbfa tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:17.856002 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-7c2d2db3-1ac3-4ded-badf-900bd441bbfa tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:17.857244 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-7c2d2db3-1ac3-4ded-badf-900bd441bbfa tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:18.184587 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-f7d13ab6-76e3-48ac-a587-4db43e7c985c tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1664dba0cd9b4d9da1e4b78691b8567e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fcf03712c6f4926a2a95dfd0519536a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:35:18.200682 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-f7d13ab6-76e3-48ac-a587-4db43e7c985c tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] 10.222.0.65 "GET /compute/v2.1/servers/89cb2230-d75e-4c8c-b47b-83f1698654dd" status: 200 len: 1358 microversion: 2.1 time: 0.641021 May 19 21:35:18.214356 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 180/352] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:35:17 2022] GET /compute/v2.1/servers/89cb2230-d75e-4c8c-b47b-83f1698654dd => generated 1358 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:35:18.282306 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_cell0:SELECT=12 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:35:18.341866 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-5a863370-bf1e-42f6-b42b-97b59913391b tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:35:18.343079 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-5a863370-bf1e-42f6-b42b-97b59913391b tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: e51de034-1fec-4513-a375-6b28e6180d82] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:35:18.369879 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5a863370-bf1e-42f6-b42b-97b59913391b tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:18.376067 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5a863370-bf1e-42f6-b42b-97b59913391b tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:18.382176 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5a863370-bf1e-42f6-b42b-97b59913391b tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:18.384443 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5a863370-bf1e-42f6-b42b-97b59913391b tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:18.739064 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-7c2d2db3-1ac3-4ded-badf-900bd441bbfa tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a58f82117ab437cab5607c204c86547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4951b93f86e1485692a4aae7b9ece8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:35:18.766117 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-7c2d2db3-1ac3-4ded-badf-900bd441bbfa tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] 10.222.0.65 "GET /compute/v2.1/servers/6442f189-c760-45c5-8313-4f1d3fe46461" status: 200 len: 1267 microversion: 2.1 time: 1.034953 May 19 21:35:18.777111 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 173/353] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:35:17 2022] GET /compute/v2.1/servers/6442f189-c760-45c5-8313-4f1d3fe46461 => generated 1267 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:35:18.863921 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-5a863370-bf1e-42f6-b42b-97b59913391b tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1589968f375946a38e82ec484afc837f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c62c1f3c54f568abdac37360ab457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:35:18.879591 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-5a863370-bf1e-42f6-b42b-97b59913391b tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "GET /compute/v2.1/servers/e51de034-1fec-4513-a375-6b28e6180d82" status: 200 len: 1564 microversion: 2.1 time: 0.542523 May 19 21:35:18.891930 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 181/354] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:35:18 2022] GET /compute/v2.1/servers/e51de034-1fec-4513-a375-6b28e6180d82 => generated 1564 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 21:35:18.903736 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-60de2bbb-9807-4c95-872a-261fd8cdcb54 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:35:18.904540 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-60de2bbb-9807-4c95-872a-261fd8cdcb54 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: e51de034-1fec-4513-a375-6b28e6180d82] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:35:18.919519 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-60de2bbb-9807-4c95-872a-261fd8cdcb54 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:18.920296 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-60de2bbb-9807-4c95-872a-261fd8cdcb54 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:18.925458 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-60de2bbb-9807-4c95-872a-261fd8cdcb54 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:18.926497 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-60de2bbb-9807-4c95-872a-261fd8cdcb54 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:19.185248 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-60de2bbb-9807-4c95-872a-261fd8cdcb54 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "GET /compute/v2.1/servers/e51de034-1fec-4513-a375-6b28e6180d82/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.289876 May 19 21:35:19.194132 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 174/355] 10.222.0.65 () {58 vars in 1274 bytes} [Thu May 19 21:35:18 2022] GET /compute/v2.1/servers/e51de034-1fec-4513-a375-6b28e6180d82/os-interface => generated 284 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 21:35:19.228811 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-84d87180-7413-43a2-aeba-84b4c0c040af tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:35:19.229712 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-84d87180-7413-43a2-aeba-84b4c0c040af tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] [instance: 89cb2230-d75e-4c8c-b47b-83f1698654dd] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:35:19.237865 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-84d87180-7413-43a2-aeba-84b4c0c040af tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:19.238773 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-84d87180-7413-43a2-aeba-84b4c0c040af tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:19.239973 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-84d87180-7413-43a2-aeba-84b4c0c040af tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:19.240822 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-84d87180-7413-43a2-aeba-84b4c0c040af tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:19.796890 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-d5d550ea-6898-4ce0-a1c2-a4551c42b7e6 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:35:19.799398 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-d5d550ea-6898-4ce0-a1c2-a4551c42b7e6 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] [instance: 6442f189-c760-45c5-8313-4f1d3fe46461] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:35:19.810607 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:35:19.831851 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-d5d550ea-6898-4ce0-a1c2-a4551c42b7e6 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:19.835724 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-d5d550ea-6898-4ce0-a1c2-a4551c42b7e6 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:19.835724 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-d5d550ea-6898-4ce0-a1c2-a4551c42b7e6 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:19.835724 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-d5d550ea-6898-4ce0-a1c2-a4551c42b7e6 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:20.483827 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-d5d550ea-6898-4ce0-a1c2-a4551c42b7e6 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a58f82117ab437cab5607c204c86547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4951b93f86e1485692a4aae7b9ece8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:35:20.502955 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-d5d550ea-6898-4ce0-a1c2-a4551c42b7e6 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] 10.222.0.65 "GET /compute/v2.1/servers/6442f189-c760-45c5-8313-4f1d3fe46461" status: 200 len: 1267 microversion: 2.1 time: 0.720987 May 19 21:35:20.523971 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 175/356] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:35:19 2022] GET /compute/v2.1/servers/6442f189-c760-45c5-8313-4f1d3fe46461 => generated 1267 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 21:35:20.536733 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [req-320ecd5f-f364-477f-a65b-a387ac833a7a req-7cc8a84b-777f-47aa-b05b-2b1eabcff3a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89cb2230-d75e-4c8c-b47b-83f1698654dd", "tag": "c48b591a-ce03-49e5-b5c1-3715c76df0d6"}]} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:35:20.548812 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-320ecd5f-f364-477f-a65b-a387ac833a7a req-7cc8a84b-777f-47aa-b05b-2b1eabcff3a4 service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:20.549653 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-320ecd5f-f364-477f-a65b-a387ac833a7a req-7cc8a84b-777f-47aa-b05b-2b1eabcff3a4 service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:20.581366 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.compute.server_external_events [req-320ecd5f-f364-477f-a65b-a387ac833a7a req-7cc8a84b-777f-47aa-b05b-2b1eabcff3a4 service nova] Creating event network-changed:c48b591a-ce03-49e5-b5c1-3715c76df0d6 for instance 89cb2230-d75e-4c8c-b47b-83f1698654dd on hv-cinder-83563 May 19 21:35:20.602030 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [req-320ecd5f-f364-477f-a65b-a387ac833a7a req-7cc8a84b-777f-47aa-b05b-2b1eabcff3a4 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076302 May 19 21:35:20.602693 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 176/357] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 21:35:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 21:35:21.304321 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [req-5333cb16-f391-4ad7-9316-bfacd668e43c req-3f239e1a-dae6-4c6e-9412-67174b2f2485 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6442f189-c760-45c5-8313-4f1d3fe46461", "name": "network-vif-plugged", "status": "completed", "tag": "2963a31a-a224-4676-b867-1f60fa8904c2"}]} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:35:21.337036 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-5333cb16-f391-4ad7-9316-bfacd668e43c req-3f239e1a-dae6-4c6e-9412-67174b2f2485 service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:21.339562 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-5333cb16-f391-4ad7-9316-bfacd668e43c req-3f239e1a-dae6-4c6e-9412-67174b2f2485 service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:21.395632 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.compute.server_external_events [req-5333cb16-f391-4ad7-9316-bfacd668e43c req-3f239e1a-dae6-4c6e-9412-67174b2f2485 service nova] Creating event network-vif-plugged:2963a31a-a224-4676-b867-1f60fa8904c2 for instance 6442f189-c760-45c5-8313-4f1d3fe46461 on hv-cinder-83563 May 19 21:35:21.429982 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [req-5333cb16-f391-4ad7-9316-bfacd668e43c req-3f239e1a-dae6-4c6e-9412-67174b2f2485 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137865 May 19 21:35:21.441586 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 177/358] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 21:35:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 21:35:21.533886 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-b972eb2c-f791-4c6d-9873-2593dbbe4844 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:35:21.544555 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-b972eb2c-f791-4c6d-9873-2593dbbe4844 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] [instance: 6442f189-c760-45c5-8313-4f1d3fe46461] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:35:21.565882 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-b972eb2c-f791-4c6d-9873-2593dbbe4844 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:21.567718 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-b972eb2c-f791-4c6d-9873-2593dbbe4844 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:21.575044 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-b972eb2c-f791-4c6d-9873-2593dbbe4844 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:21.577008 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-b972eb2c-f791-4c6d-9873-2593dbbe4844 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:21.633764 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-84d87180-7413-43a2-aeba-84b4c0c040af tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1664dba0cd9b4d9da1e4b78691b8567e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fcf03712c6f4926a2a95dfd0519536a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:35:21.678187 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-84d87180-7413-43a2-aeba-84b4c0c040af tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] 10.222.0.65 "GET /compute/v2.1/servers/89cb2230-d75e-4c8c-b47b-83f1698654dd" status: 200 len: 1358 microversion: 2.1 time: 2.452909 May 19 21:35:21.690274 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 182/359] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:35:19 2022] GET /compute/v2.1/servers/89cb2230-d75e-4c8c-b47b-83f1698654dd => generated 1358 bytes in 2457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:35:22.130298 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-b972eb2c-f791-4c6d-9873-2593dbbe4844 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a58f82117ab437cab5607c204c86547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4951b93f86e1485692a4aae7b9ece8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:35:22.134919 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_cell1:SELECT=100 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:35:22.145333 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-b972eb2c-f791-4c6d-9873-2593dbbe4844 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] 10.222.0.65 "GET /compute/v2.1/servers/6442f189-c760-45c5-8313-4f1d3fe46461" status: 200 len: 1267 microversion: 2.1 time: 0.621776 May 19 21:35:22.145944 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 178/360] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:35:21 2022] GET /compute/v2.1/servers/6442f189-c760-45c5-8313-4f1d3fe46461 => generated 1267 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 21:35:22.708772 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-4188adc5-5f8a-42b1-822f-8c724e583167 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:35:22.709537 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-4188adc5-5f8a-42b1-822f-8c724e583167 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] [instance: 89cb2230-d75e-4c8c-b47b-83f1698654dd] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:35:22.726380 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4188adc5-5f8a-42b1-822f-8c724e583167 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:22.726846 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4188adc5-5f8a-42b1-822f-8c724e583167 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:22.727638 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4188adc5-5f8a-42b1-822f-8c724e583167 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:22.728072 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4188adc5-5f8a-42b1-822f-8c724e583167 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:22.933785 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [req-361566ec-f8ea-4a48-a097-5e262bffb2a2 req-e06e8bf9-5d2a-4701-ac67-243f72b0d4db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e51de034-1fec-4513-a375-6b28e6180d82", "tag": "f6476118-5256-4fbe-bbbd-6fb7f8cb02c1"}]} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:35:22.954301 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-361566ec-f8ea-4a48-a097-5e262bffb2a2 req-e06e8bf9-5d2a-4701-ac67-243f72b0d4db service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:22.954769 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-361566ec-f8ea-4a48-a097-5e262bffb2a2 req-e06e8bf9-5d2a-4701-ac67-243f72b0d4db service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:22.985985 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.compute.server_external_events [req-361566ec-f8ea-4a48-a097-5e262bffb2a2 req-e06e8bf9-5d2a-4701-ac67-243f72b0d4db service nova] Creating event network-changed:f6476118-5256-4fbe-bbbd-6fb7f8cb02c1 for instance e51de034-1fec-4513-a375-6b28e6180d82 on hv-cinder-83563 May 19 21:35:23.004642 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [req-361566ec-f8ea-4a48-a097-5e262bffb2a2 req-e06e8bf9-5d2a-4701-ac67-243f72b0d4db service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069035 May 19 21:35:23.005306 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 179/361] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 21:35:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 21:35:23.022682 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-4188adc5-5f8a-42b1-822f-8c724e583167 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1664dba0cd9b4d9da1e4b78691b8567e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fcf03712c6f4926a2a95dfd0519536a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:35:23.031475 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-4188adc5-5f8a-42b1-822f-8c724e583167 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] 10.222.0.65 "GET /compute/v2.1/servers/89cb2230-d75e-4c8c-b47b-83f1698654dd" status: 200 len: 1358 microversion: 2.1 time: 0.326603 May 19 21:35:23.046257 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 183/362] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:35:22 2022] GET /compute/v2.1/servers/89cb2230-d75e-4c8c-b47b-83f1698654dd => generated 1358 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:35:23.122912 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-c20de000-411b-4e76-944b-8c44129d7bcf tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-463613868", "imageRef": "a874457a-f8a8-46f6-bdcc-1fa632a0d3c0", "flavorRef": "452", "networks": [{"uuid": "00bbdffb-749b-4e56-86f3-df5fdbc057b9"}]}} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:35:23.165845 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-ec7a0576-77ab-499a-b3ec-1da6ef5ac697 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:35:23.166923 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-ec7a0576-77ab-499a-b3ec-1da6ef5ac697 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] [instance: 6442f189-c760-45c5-8313-4f1d3fe46461] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:35:23.174578 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ec7a0576-77ab-499a-b3ec-1da6ef5ac697 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:23.175466 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ec7a0576-77ab-499a-b3ec-1da6ef5ac697 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:23.176467 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ec7a0576-77ab-499a-b3ec-1da6ef5ac697 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:23.177128 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ec7a0576-77ab-499a-b3ec-1da6ef5ac697 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:23.223909 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell1:SELECT=100 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:35:23.522500 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-ec7a0576-77ab-499a-b3ec-1da6ef5ac697 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a58f82117ab437cab5607c204c86547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4951b93f86e1485692a4aae7b9ece8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:35:23.546141 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-ec7a0576-77ab-499a-b3ec-1da6ef5ac697 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] 10.222.0.65 "GET /compute/v2.1/servers/6442f189-c760-45c5-8313-4f1d3fe46461" status: 200 len: 1267 microversion: 2.1 time: 0.377855 May 19 21:35:23.546141 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 184/363] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:35:23 2022] GET /compute/v2.1/servers/6442f189-c760-45c5-8313-4f1d3fe46461 => generated 1267 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:35:23.620664 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.network.neutron [None req-c20de000-411b-4e76-944b-8c44129d7bcf tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] validate_networks() for [('00bbdffb-749b-4e56-86f3-df5fdbc057b9', None, None, None, None, None)] {{(pid=124349) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 19 21:35:24.050676 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-773743c5-59b1-4bce-b522-3a171948c89f tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:35:24.051743 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-773743c5-59b1-4bce-b522-3a171948c89f tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] [instance: 89cb2230-d75e-4c8c-b47b-83f1698654dd] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:35:24.076262 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-773743c5-59b1-4bce-b522-3a171948c89f tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:24.077534 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-773743c5-59b1-4bce-b522-3a171948c89f tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:24.078843 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-773743c5-59b1-4bce-b522-3a171948c89f tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:24.079566 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-773743c5-59b1-4bce-b522-3a171948c89f tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:24.312305 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-773743c5-59b1-4bce-b522-3a171948c89f tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1664dba0cd9b4d9da1e4b78691b8567e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fcf03712c6f4926a2a95dfd0519536a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:35:24.324131 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-773743c5-59b1-4bce-b522-3a171948c89f tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] 10.222.0.65 "GET /compute/v2.1/servers/89cb2230-d75e-4c8c-b47b-83f1698654dd" status: 200 len: 1358 microversion: 2.1 time: 0.277736 May 19 21:35:24.326488 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 185/364] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:35:24 2022] GET /compute/v2.1/servers/89cb2230-d75e-4c8c-b47b-83f1698654dd => generated 1358 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 21:35:24.352613 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.virt.hardware [None req-c20de000-411b-4e76-944b-8c44129d7bcf tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Flavor limits 0:0:0 {{(pid=124349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 21:35:24.353138 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.virt.hardware [None req-c20de000-411b-4e76-944b-8c44129d7bcf tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Image limits 0:0:0 {{(pid=124349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 21:35:24.353612 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.virt.hardware [None req-c20de000-411b-4e76-944b-8c44129d7bcf tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Flavor pref 0:0:0 {{(pid=124349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 21:35:24.354288 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.virt.hardware [None req-c20de000-411b-4e76-944b-8c44129d7bcf tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Image pref 0:0:0 {{(pid=124349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 21:35:24.354685 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.virt.hardware [None req-c20de000-411b-4e76-944b-8c44129d7bcf tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 21:35:24.380679 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c20de000-411b-4e76-944b-8c44129d7bcf tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:24.381444 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c20de000-411b-4e76-944b-8c44129d7bcf tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:24.383077 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c20de000-411b-4e76-944b-8c44129d7bcf tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:24.383862 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c20de000-411b-4e76-944b-8c44129d7bcf tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:24.421707 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.quota [None req-c20de000-411b-4e76-944b-8c44129d7bcf tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Getting quotas for project 120a6c484bec4e52bc5891c927647e75. Resources: {'ram', 'cores', 'instances'} {{(pid=124349) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 21:35:24.437346 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.quota [None req-c20de000-411b-4e76-944b-8c44129d7bcf tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Getting quotas for user 1ad8b76baf294f91bc4c641280ab03f7 and project 120a6c484bec4e52bc5891c927647e75. Resources: {'ram', 'cores', 'instances'} {{(pid=124349) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 21:35:24.459335 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-c20de000-411b-4e76-944b-8c44129d7bcf tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Going to run 1 instances... {{(pid=124349) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 21:35:24.462185 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-c20de000-411b-4e76-944b-8c44129d7bcf tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] [instance: 8b820379-bb78-465a-a84d-7c1e945c74da] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a874457a-f8a8-46f6-bdcc-1fa632a0d3c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124349) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 21:35:24.545863 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-c20de000-411b-4e76-944b-8c44129d7bcf tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.432520 May 19 21:35:24.553051 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 180/365] 10.222.0.65 () {60 vars in 1146 bytes} [Thu May 19 21:35:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1436 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 21:35:24.561182 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-ef6a7ccb-8404-4aaa-909b-aa5164cb1a8f tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:35:24.562125 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-ef6a7ccb-8404-4aaa-909b-aa5164cb1a8f tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] [instance: 8b820379-bb78-465a-a84d-7c1e945c74da] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:35:24.568129 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-6f8db6f4-a126-4683-aa72-c4133fed6cbb tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:35:24.569274 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-6f8db6f4-a126-4683-aa72-c4133fed6cbb tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] [instance: 6442f189-c760-45c5-8313-4f1d3fe46461] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:35:24.594280 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-6f8db6f4-a126-4683-aa72-c4133fed6cbb tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:24.595082 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-6f8db6f4-a126-4683-aa72-c4133fed6cbb tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:24.596595 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-6f8db6f4-a126-4683-aa72-c4133fed6cbb tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:24.597368 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-6f8db6f4-a126-4683-aa72-c4133fed6cbb tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:24.655042 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-ef6a7ccb-8404-4aaa-909b-aa5164cb1a8f tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ad8b76baf294f91bc4c641280ab03f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '120a6c484bec4e52bc5891c927647e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:35:24.663594 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-ef6a7ccb-8404-4aaa-909b-aa5164cb1a8f tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] 10.222.0.65 "GET /compute/v2.1/servers/8b820379-bb78-465a-a84d-7c1e945c74da" status: 200 len: 1218 microversion: 2.1 time: 0.108968 May 19 21:35:24.666046 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 186/366] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:35:24 2022] GET /compute/v2.1/servers/8b820379-bb78-465a-a84d-7c1e945c74da => generated 1218 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:35:24.960850 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-6f8db6f4-a126-4683-aa72-c4133fed6cbb tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a58f82117ab437cab5607c204c86547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4951b93f86e1485692a4aae7b9ece8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:35:24.970968 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-6f8db6f4-a126-4683-aa72-c4133fed6cbb tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] 10.222.0.65 "GET /compute/v2.1/servers/6442f189-c760-45c5-8313-4f1d3fe46461" status: 200 len: 1267 microversion: 2.1 time: 0.410562 May 19 21:35:24.972877 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 181/367] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:35:24 2022] GET /compute/v2.1/servers/6442f189-c760-45c5-8313-4f1d3fe46461 => generated 1267 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:35:25.346176 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-5e8fa06b-33b7-4c7c-9d94-857863a62d1a tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:35:25.347626 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-5e8fa06b-33b7-4c7c-9d94-857863a62d1a tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] [instance: 89cb2230-d75e-4c8c-b47b-83f1698654dd] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:35:25.355934 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5e8fa06b-33b7-4c7c-9d94-857863a62d1a tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:25.356840 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5e8fa06b-33b7-4c7c-9d94-857863a62d1a tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:25.358256 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5e8fa06b-33b7-4c7c-9d94-857863a62d1a tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:25.358927 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5e8fa06b-33b7-4c7c-9d94-857863a62d1a tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:25.650793 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-5e8fa06b-33b7-4c7c-9d94-857863a62d1a tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1664dba0cd9b4d9da1e4b78691b8567e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fcf03712c6f4926a2a95dfd0519536a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:35:25.660622 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-5e8fa06b-33b7-4c7c-9d94-857863a62d1a tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] 10.222.0.65 "GET /compute/v2.1/servers/89cb2230-d75e-4c8c-b47b-83f1698654dd" status: 200 len: 1358 microversion: 2.1 time: 0.319088 May 19 21:35:25.671421 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 187/368] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:35:25 2022] GET /compute/v2.1/servers/89cb2230-d75e-4c8c-b47b-83f1698654dd => generated 1358 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 21:35:25.683245 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-ee5f45d0-db33-419a-922a-2341a47822b3 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:35:25.684072 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-ee5f45d0-db33-419a-922a-2341a47822b3 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] [instance: 8b820379-bb78-465a-a84d-7c1e945c74da] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:35:25.692265 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ee5f45d0-db33-419a-922a-2341a47822b3 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:25.692901 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ee5f45d0-db33-419a-922a-2341a47822b3 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:25.693709 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ee5f45d0-db33-419a-922a-2341a47822b3 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:25.694609 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ee5f45d0-db33-419a-922a-2341a47822b3 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:25.867920 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-ee5f45d0-db33-419a-922a-2341a47822b3 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ad8b76baf294f91bc4c641280ab03f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '120a6c484bec4e52bc5891c927647e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:35:25.884675 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-ee5f45d0-db33-419a-922a-2341a47822b3 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] 10.222.0.65 "GET /compute/v2.1/servers/8b820379-bb78-465a-a84d-7c1e945c74da" status: 200 len: 1222 microversion: 2.1 time: 0.205357 May 19 21:35:25.886516 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 182/369] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:35:25 2022] GET /compute/v2.1/servers/8b820379-bb78-465a-a84d-7c1e945c74da => generated 1222 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 21:35:25.992887 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-a6078213-660d-4c01-83d1-ca786ddfc8c6 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:35:25.993596 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-a6078213-660d-4c01-83d1-ca786ddfc8c6 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] [instance: 6442f189-c760-45c5-8313-4f1d3fe46461] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:35:26.001891 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a6078213-660d-4c01-83d1-ca786ddfc8c6 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:26.002661 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a6078213-660d-4c01-83d1-ca786ddfc8c6 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:26.003586 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a6078213-660d-4c01-83d1-ca786ddfc8c6 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:26.004026 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a6078213-660d-4c01-83d1-ca786ddfc8c6 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:26.267848 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-a6078213-660d-4c01-83d1-ca786ddfc8c6 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a58f82117ab437cab5607c204c86547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4951b93f86e1485692a4aae7b9ece8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:35:26.283816 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-a6078213-660d-4c01-83d1-ca786ddfc8c6 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] 10.222.0.65 "GET /compute/v2.1/servers/6442f189-c760-45c5-8313-4f1d3fe46461" status: 200 len: 1267 microversion: 2.1 time: 0.295248 May 19 21:35:26.285201 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 188/370] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:35:25 2022] GET /compute/v2.1/servers/6442f189-c760-45c5-8313-4f1d3fe46461 => generated 1267 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 21:35:26.679670 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-33c867f8-9f67-42b9-a457-56f42ea08ad3 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:35:26.682764 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-33c867f8-9f67-42b9-a457-56f42ea08ad3 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] [instance: 89cb2230-d75e-4c8c-b47b-83f1698654dd] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:35:26.692777 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-33c867f8-9f67-42b9-a457-56f42ea08ad3 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:26.694003 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-33c867f8-9f67-42b9-a457-56f42ea08ad3 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:26.694162 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-33c867f8-9f67-42b9-a457-56f42ea08ad3 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:26.694497 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-33c867f8-9f67-42b9-a457-56f42ea08ad3 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:26.901761 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-33c867f8-9f67-42b9-a457-56f42ea08ad3 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1664dba0cd9b4d9da1e4b78691b8567e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fcf03712c6f4926a2a95dfd0519536a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:35:26.908062 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-e26cc0e0-6367-46d9-8eee-7cfba2d2b546 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:35:26.909171 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-e26cc0e0-6367-46d9-8eee-7cfba2d2b546 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] [instance: 8b820379-bb78-465a-a84d-7c1e945c74da] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:35:26.920441 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e26cc0e0-6367-46d9-8eee-7cfba2d2b546 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:26.921533 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e26cc0e0-6367-46d9-8eee-7cfba2d2b546 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:26.921891 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-33c867f8-9f67-42b9-a457-56f42ea08ad3 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] 10.222.0.65 "GET /compute/v2.1/servers/89cb2230-d75e-4c8c-b47b-83f1698654dd" status: 200 len: 1358 microversion: 2.1 time: 0.246190 May 19 21:35:26.930303 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 183/371] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:35:26 2022] GET /compute/v2.1/servers/89cb2230-d75e-4c8c-b47b-83f1698654dd => generated 1358 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:35:26.937357 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e26cc0e0-6367-46d9-8eee-7cfba2d2b546 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:26.940001 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e26cc0e0-6367-46d9-8eee-7cfba2d2b546 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:27.041897 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-e26cc0e0-6367-46d9-8eee-7cfba2d2b546 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ad8b76baf294f91bc4c641280ab03f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '120a6c484bec4e52bc5891c927647e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:35:27.057307 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-e26cc0e0-6367-46d9-8eee-7cfba2d2b546 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] 10.222.0.65 "GET /compute/v2.1/servers/8b820379-bb78-465a-a84d-7c1e945c74da" status: 200 len: 1222 microversion: 2.1 time: 0.156615 May 19 21:35:27.058804 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 189/372] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:35:26 2022] GET /compute/v2.1/servers/8b820379-bb78-465a-a84d-7c1e945c74da => generated 1222 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:35:27.312099 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-5559524f-255c-4196-a569-5d9c104e2b7e tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:35:27.312706 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-5559524f-255c-4196-a569-5d9c104e2b7e tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] [instance: 6442f189-c760-45c5-8313-4f1d3fe46461] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:35:27.319935 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-5559524f-255c-4196-a569-5d9c104e2b7e tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:27.320666 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-5559524f-255c-4196-a569-5d9c104e2b7e tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:27.321718 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-5559524f-255c-4196-a569-5d9c104e2b7e tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:27.322563 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-5559524f-255c-4196-a569-5d9c104e2b7e tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:27.560615 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-5559524f-255c-4196-a569-5d9c104e2b7e tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a58f82117ab437cab5607c204c86547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4951b93f86e1485692a4aae7b9ece8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:35:27.570976 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-5559524f-255c-4196-a569-5d9c104e2b7e tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] 10.222.0.65 "GET /compute/v2.1/servers/6442f189-c760-45c5-8313-4f1d3fe46461" status: 200 len: 1267 microversion: 2.1 time: 0.262445 May 19 21:35:27.571948 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 184/373] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:35:27 2022] GET /compute/v2.1/servers/6442f189-c760-45c5-8313-4f1d3fe46461 => generated 1267 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:35:27.952641 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-2c0febb5-4195-4cb0-89a3-a3be8c1a2bb5 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:35:27.953723 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-2c0febb5-4195-4cb0-89a3-a3be8c1a2bb5 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] [instance: 89cb2230-d75e-4c8c-b47b-83f1698654dd] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:35:27.966920 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2c0febb5-4195-4cb0-89a3-a3be8c1a2bb5 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:27.967908 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2c0febb5-4195-4cb0-89a3-a3be8c1a2bb5 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:27.969245 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2c0febb5-4195-4cb0-89a3-a3be8c1a2bb5 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:27.970008 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2c0febb5-4195-4cb0-89a3-a3be8c1a2bb5 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:28.076199 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-79e58deb-0f73-4fbe-a5e5-8eaaafe8573f tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:35:28.079309 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-79e58deb-0f73-4fbe-a5e5-8eaaafe8573f tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] [instance: 8b820379-bb78-465a-a84d-7c1e945c74da] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:35:28.098885 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-79e58deb-0f73-4fbe-a5e5-8eaaafe8573f tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:28.099323 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-79e58deb-0f73-4fbe-a5e5-8eaaafe8573f tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:28.100317 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-79e58deb-0f73-4fbe-a5e5-8eaaafe8573f tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:28.100910 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-79e58deb-0f73-4fbe-a5e5-8eaaafe8573f tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:28.185801 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-2c0febb5-4195-4cb0-89a3-a3be8c1a2bb5 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1664dba0cd9b4d9da1e4b78691b8567e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fcf03712c6f4926a2a95dfd0519536a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:35:28.195001 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-2c0febb5-4195-4cb0-89a3-a3be8c1a2bb5 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] 10.222.0.65 "GET /compute/v2.1/servers/89cb2230-d75e-4c8c-b47b-83f1698654dd" status: 200 len: 1358 microversion: 2.1 time: 0.249891 May 19 21:35:28.195754 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 190/374] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:35:27 2022] GET /compute/v2.1/servers/89cb2230-d75e-4c8c-b47b-83f1698654dd => generated 1358 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:35:28.240197 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-79e58deb-0f73-4fbe-a5e5-8eaaafe8573f tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ad8b76baf294f91bc4c641280ab03f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '120a6c484bec4e52bc5891c927647e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:35:28.248576 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-79e58deb-0f73-4fbe-a5e5-8eaaafe8573f tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] 10.222.0.65 "GET /compute/v2.1/servers/8b820379-bb78-465a-a84d-7c1e945c74da" status: 200 len: 1222 microversion: 2.1 time: 0.176845 May 19 21:35:28.249156 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 185/375] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:35:28 2022] GET /compute/v2.1/servers/8b820379-bb78-465a-a84d-7c1e945c74da => generated 1222 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:35:28.598762 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-dc23e2c7-fa79-4b19-84fd-15503bc596c5 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:35:28.600023 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-dc23e2c7-fa79-4b19-84fd-15503bc596c5 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] [instance: 6442f189-c760-45c5-8313-4f1d3fe46461] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:35:28.619324 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-dc23e2c7-fa79-4b19-84fd-15503bc596c5 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:28.619835 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-dc23e2c7-fa79-4b19-84fd-15503bc596c5 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:28.620752 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-dc23e2c7-fa79-4b19-84fd-15503bc596c5 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:28.621434 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-dc23e2c7-fa79-4b19-84fd-15503bc596c5 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:28.826277 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-dc23e2c7-fa79-4b19-84fd-15503bc596c5 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a58f82117ab437cab5607c204c86547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4951b93f86e1485692a4aae7b9ece8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:35:28.838286 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-dc23e2c7-fa79-4b19-84fd-15503bc596c5 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] 10.222.0.65 "GET /compute/v2.1/servers/6442f189-c760-45c5-8313-4f1d3fe46461" status: 200 len: 1267 microversion: 2.1 time: 0.249648 May 19 21:35:28.839306 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 191/376] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:35:28 2022] GET /compute/v2.1/servers/6442f189-c760-45c5-8313-4f1d3fe46461 => generated 1267 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:35:29.213301 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-3f0f1e41-5b2a-42a5-997d-37a75dae1059 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:35:29.214190 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-3f0f1e41-5b2a-42a5-997d-37a75dae1059 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] [instance: 89cb2230-d75e-4c8c-b47b-83f1698654dd] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:35:29.222693 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-3f0f1e41-5b2a-42a5-997d-37a75dae1059 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:29.223224 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-3f0f1e41-5b2a-42a5-997d-37a75dae1059 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:29.224087 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-3f0f1e41-5b2a-42a5-997d-37a75dae1059 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:29.224585 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-3f0f1e41-5b2a-42a5-997d-37a75dae1059 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:29.266120 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-4b4ae9fc-12e3-4552-904b-68780e988cf5 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:35:29.266999 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-4b4ae9fc-12e3-4552-904b-68780e988cf5 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] [instance: 8b820379-bb78-465a-a84d-7c1e945c74da] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:35:29.276513 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4b4ae9fc-12e3-4552-904b-68780e988cf5 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:29.277120 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4b4ae9fc-12e3-4552-904b-68780e988cf5 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:29.278118 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4b4ae9fc-12e3-4552-904b-68780e988cf5 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:29.278790 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4b4ae9fc-12e3-4552-904b-68780e988cf5 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:29.348203 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-4b4ae9fc-12e3-4552-904b-68780e988cf5 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ad8b76baf294f91bc4c641280ab03f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '120a6c484bec4e52bc5891c927647e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:35:29.356246 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-4b4ae9fc-12e3-4552-904b-68780e988cf5 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] 10.222.0.65 "GET /compute/v2.1/servers/8b820379-bb78-465a-a84d-7c1e945c74da" status: 200 len: 1222 microversion: 2.1 time: 0.094824 May 19 21:35:29.357008 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 192/377] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:35:29 2022] GET /compute/v2.1/servers/8b820379-bb78-465a-a84d-7c1e945c74da => generated 1222 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 21:35:29.426873 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-3f0f1e41-5b2a-42a5-997d-37a75dae1059 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1664dba0cd9b4d9da1e4b78691b8567e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fcf03712c6f4926a2a95dfd0519536a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:35:29.437554 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-3f0f1e41-5b2a-42a5-997d-37a75dae1059 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] 10.222.0.65 "GET /compute/v2.1/servers/89cb2230-d75e-4c8c-b47b-83f1698654dd" status: 200 len: 1358 microversion: 2.1 time: 0.228367 May 19 21:35:29.438719 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 186/378] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:35:29 2022] GET /compute/v2.1/servers/89cb2230-d75e-4c8c-b47b-83f1698654dd => generated 1358 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:35:29.856447 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-0fac6c0f-8d3f-4afa-9ce3-04530cc831c1 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:35:29.857663 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-0fac6c0f-8d3f-4afa-9ce3-04530cc831c1 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] [instance: 6442f189-c760-45c5-8313-4f1d3fe46461] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:35:29.866375 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0fac6c0f-8d3f-4afa-9ce3-04530cc831c1 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:29.866894 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0fac6c0f-8d3f-4afa-9ce3-04530cc831c1 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:29.867902 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0fac6c0f-8d3f-4afa-9ce3-04530cc831c1 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:29.868422 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0fac6c0f-8d3f-4afa-9ce3-04530cc831c1 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:30.040523 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-0fac6c0f-8d3f-4afa-9ce3-04530cc831c1 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a58f82117ab437cab5607c204c86547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4951b93f86e1485692a4aae7b9ece8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:35:30.049191 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-0fac6c0f-8d3f-4afa-9ce3-04530cc831c1 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] 10.222.0.65 "GET /compute/v2.1/servers/6442f189-c760-45c5-8313-4f1d3fe46461" status: 200 len: 1267 microversion: 2.1 time: 0.196671 May 19 21:35:30.049864 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 193/379] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:35:29 2022] GET /compute/v2.1/servers/6442f189-c760-45c5-8313-4f1d3fe46461 => generated 1267 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:35:30.374665 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-f6bb42d5-d431-4a16-8447-891eeee7ea49 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:35:30.375341 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-f6bb42d5-d431-4a16-8447-891eeee7ea49 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] [instance: 8b820379-bb78-465a-a84d-7c1e945c74da] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:35:30.381916 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f6bb42d5-d431-4a16-8447-891eeee7ea49 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:30.382382 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f6bb42d5-d431-4a16-8447-891eeee7ea49 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:30.383147 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f6bb42d5-d431-4a16-8447-891eeee7ea49 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:30.383567 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f6bb42d5-d431-4a16-8447-891eeee7ea49 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:30.448173 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-f6bb42d5-d431-4a16-8447-891eeee7ea49 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ad8b76baf294f91bc4c641280ab03f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '120a6c484bec4e52bc5891c927647e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:35:30.458290 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-f6bb42d5-d431-4a16-8447-891eeee7ea49 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] 10.222.0.65 "GET /compute/v2.1/servers/8b820379-bb78-465a-a84d-7c1e945c74da" status: 200 len: 1222 microversion: 2.1 time: 0.087521 May 19 21:35:30.458871 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 187/380] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:35:30 2022] GET /compute/v2.1/servers/8b820379-bb78-465a-a84d-7c1e945c74da => generated 1222 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:35:30.461085 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-1cea43af-9e51-428b-b37a-4d5e3132cd0d tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:35:30.461709 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-1cea43af-9e51-428b-b37a-4d5e3132cd0d tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] [instance: 89cb2230-d75e-4c8c-b47b-83f1698654dd] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:35:30.469420 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1cea43af-9e51-428b-b37a-4d5e3132cd0d tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:30.469869 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1cea43af-9e51-428b-b37a-4d5e3132cd0d tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:30.470673 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1cea43af-9e51-428b-b37a-4d5e3132cd0d tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:30.471099 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1cea43af-9e51-428b-b37a-4d5e3132cd0d tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:30.620262 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-1cea43af-9e51-428b-b37a-4d5e3132cd0d tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1664dba0cd9b4d9da1e4b78691b8567e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fcf03712c6f4926a2a95dfd0519536a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:35:30.628873 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-1cea43af-9e51-428b-b37a-4d5e3132cd0d tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] 10.222.0.65 "GET /compute/v2.1/servers/89cb2230-d75e-4c8c-b47b-83f1698654dd" status: 200 len: 1358 microversion: 2.1 time: 0.171575 May 19 21:35:30.629450 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 194/381] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:35:30 2022] GET /compute/v2.1/servers/89cb2230-d75e-4c8c-b47b-83f1698654dd => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:35:30.669861 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-0246de50-af35-45d7-9b13-83062592ca11 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1072796264", "imageRef": "a874457a-f8a8-46f6-bdcc-1fa632a0d3c0", "flavorRef": "452"}} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:35:30.722971 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.network.neutron [None req-0246de50-af35-45d7-9b13-83062592ca11 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] validate_networks() for None {{(pid=124349) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 19 21:35:31.027177 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.virt.hardware [None req-0246de50-af35-45d7-9b13-83062592ca11 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Flavor limits 0:0:0 {{(pid=124349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 21:35:31.027624 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.virt.hardware [None req-0246de50-af35-45d7-9b13-83062592ca11 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Image limits 0:0:0 {{(pid=124349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 21:35:31.028104 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.virt.hardware [None req-0246de50-af35-45d7-9b13-83062592ca11 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Flavor pref 0:0:0 {{(pid=124349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 21:35:31.028504 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.virt.hardware [None req-0246de50-af35-45d7-9b13-83062592ca11 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Image pref 0:0:0 {{(pid=124349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 21:35:31.028908 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.virt.hardware [None req-0246de50-af35-45d7-9b13-83062592ca11 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 21:35:31.040819 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-0246de50-af35-45d7-9b13-83062592ca11 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:31.040819 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-0246de50-af35-45d7-9b13-83062592ca11 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:31.041459 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-0246de50-af35-45d7-9b13-83062592ca11 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:31.041887 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-0246de50-af35-45d7-9b13-83062592ca11 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:31.062227 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.quota [None req-0246de50-af35-45d7-9b13-83062592ca11 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Getting quotas for project c887b19b903a4702b2812ef9b5b88ddc. Resources: {'ram', 'cores', 'instances'} {{(pid=124349) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 21:35:31.066444 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-1142be1e-63df-4209-bb59-a65b6b3ba118 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:35:31.067180 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.quota [None req-0246de50-af35-45d7-9b13-83062592ca11 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Getting quotas for user 4113ddb776d144f0ae2bb2b7d28e775a and project c887b19b903a4702b2812ef9b5b88ddc. Resources: {'ram', 'cores', 'instances'} {{(pid=124349) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 21:35:31.067383 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-1142be1e-63df-4209-bb59-a65b6b3ba118 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] [instance: 6442f189-c760-45c5-8313-4f1d3fe46461] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:35:31.074567 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1142be1e-63df-4209-bb59-a65b6b3ba118 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:31.075421 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1142be1e-63df-4209-bb59-a65b6b3ba118 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:31.076734 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1142be1e-63df-4209-bb59-a65b6b3ba118 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:31.077370 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1142be1e-63df-4209-bb59-a65b6b3ba118 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:31.081570 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-0246de50-af35-45d7-9b13-83062592ca11 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Going to run 1 instances... {{(pid=124349) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 21:35:31.083863 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-0246de50-af35-45d7-9b13-83062592ca11 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] [instance: a331902f-10a9-4bca-bffb-8750e5f1a595] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a874457a-f8a8-46f6-bdcc-1fa632a0d3c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124349) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 21:35:31.132724 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-0246de50-af35-45d7-9b13-83062592ca11 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.468621 May 19 21:35:31.133634 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 188/382] 10.222.0.65 () {60 vars in 1146 bytes} [Thu May 19 21:35:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 471 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 21:35:31.144341 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-b70ae719-3629-4c3c-ac9c-bc29e2384ac0 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:35:31.145049 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-b70ae719-3629-4c3c-ac9c-bc29e2384ac0 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] [instance: a331902f-10a9-4bca-bffb-8750e5f1a595] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:35:31.232027 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-b70ae719-3629-4c3c-ac9c-bc29e2384ac0 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4113ddb776d144f0ae2bb2b7d28e775a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c887b19b903a4702b2812ef9b5b88ddc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:35:31.245716 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-b70ae719-3629-4c3c-ac9c-bc29e2384ac0 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] 10.222.0.65 "GET /compute/v2.1/servers/a331902f-10a9-4bca-bffb-8750e5f1a595" status: 200 len: 1215 microversion: 2.1 time: 0.105005 May 19 21:35:31.258645 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 189/383] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:35:31 2022] GET /compute/v2.1/servers/a331902f-10a9-4bca-bffb-8750e5f1a595 => generated 1215 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:35:31.308216 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-1142be1e-63df-4209-bb59-a65b6b3ba118 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a58f82117ab437cab5607c204c86547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4951b93f86e1485692a4aae7b9ece8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:35:31.320143 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-1142be1e-63df-4209-bb59-a65b6b3ba118 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] 10.222.0.65 "GET /compute/v2.1/servers/6442f189-c760-45c5-8313-4f1d3fe46461" status: 200 len: 1267 microversion: 2.1 time: 0.257540 May 19 21:35:31.320996 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 195/384] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:35:31 2022] GET /compute/v2.1/servers/6442f189-c760-45c5-8313-4f1d3fe46461 => generated 1267 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 21:35:31.478027 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-3a0286ee-9578-478c-acb1-ff47536cb0b5 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:35:31.478825 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-3a0286ee-9578-478c-acb1-ff47536cb0b5 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] [instance: 8b820379-bb78-465a-a84d-7c1e945c74da] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:35:31.486163 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-3a0286ee-9578-478c-acb1-ff47536cb0b5 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:31.486728 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-3a0286ee-9578-478c-acb1-ff47536cb0b5 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:31.487674 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-3a0286ee-9578-478c-acb1-ff47536cb0b5 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:31.488110 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-3a0286ee-9578-478c-acb1-ff47536cb0b5 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:31.561002 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-3a0286ee-9578-478c-acb1-ff47536cb0b5 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ad8b76baf294f91bc4c641280ab03f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '120a6c484bec4e52bc5891c927647e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:35:31.571733 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-3a0286ee-9578-478c-acb1-ff47536cb0b5 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] 10.222.0.65 "GET /compute/v2.1/servers/8b820379-bb78-465a-a84d-7c1e945c74da" status: 200 len: 1222 microversion: 2.1 time: 0.098837 May 19 21:35:31.572594 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 190/385] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:35:31 2022] GET /compute/v2.1/servers/8b820379-bb78-465a-a84d-7c1e945c74da => generated 1222 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:35:31.646460 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-05691bd0-db86-4fd2-8505-e5e2f73d83ab tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:35:31.647073 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-05691bd0-db86-4fd2-8505-e5e2f73d83ab tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] [instance: 89cb2230-d75e-4c8c-b47b-83f1698654dd] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:35:31.653966 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-05691bd0-db86-4fd2-8505-e5e2f73d83ab tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:31.654485 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-05691bd0-db86-4fd2-8505-e5e2f73d83ab tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:31.655273 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-05691bd0-db86-4fd2-8505-e5e2f73d83ab tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:31.655734 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-05691bd0-db86-4fd2-8505-e5e2f73d83ab tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:31.796195 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-05691bd0-db86-4fd2-8505-e5e2f73d83ab tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1664dba0cd9b4d9da1e4b78691b8567e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fcf03712c6f4926a2a95dfd0519536a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:35:31.804397 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-05691bd0-db86-4fd2-8505-e5e2f73d83ab tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] 10.222.0.65 "GET /compute/v2.1/servers/89cb2230-d75e-4c8c-b47b-83f1698654dd" status: 200 len: 1358 microversion: 2.1 time: 0.161867 May 19 21:35:31.804957 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 196/386] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:35:31 2022] GET /compute/v2.1/servers/89cb2230-d75e-4c8c-b47b-83f1698654dd => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:35:32.266100 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-d173e9bc-565a-459a-920d-8065c3a0553b tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:35:32.266753 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-d173e9bc-565a-459a-920d-8065c3a0553b tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] [instance: a331902f-10a9-4bca-bffb-8750e5f1a595] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:35:32.273583 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-d173e9bc-565a-459a-920d-8065c3a0553b tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:32.274029 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-d173e9bc-565a-459a-920d-8065c3a0553b tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:32.274832 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-d173e9bc-565a-459a-920d-8065c3a0553b tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:32.275257 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-d173e9bc-565a-459a-920d-8065c3a0553b tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:32.338290 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-b9fae579-f2d2-429b-8bd1-4c1ad6b7a664 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:35:32.338892 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-b9fae579-f2d2-429b-8bd1-4c1ad6b7a664 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] [instance: 6442f189-c760-45c5-8313-4f1d3fe46461] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:35:32.345989 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b9fae579-f2d2-429b-8bd1-4c1ad6b7a664 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:32.346466 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b9fae579-f2d2-429b-8bd1-4c1ad6b7a664 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:32.347242 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b9fae579-f2d2-429b-8bd1-4c1ad6b7a664 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:32.347668 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b9fae579-f2d2-429b-8bd1-4c1ad6b7a664 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:32.348921 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-d173e9bc-565a-459a-920d-8065c3a0553b tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4113ddb776d144f0ae2bb2b7d28e775a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c887b19b903a4702b2812ef9b5b88ddc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:35:32.362454 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-d173e9bc-565a-459a-920d-8065c3a0553b tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] 10.222.0.65 "GET /compute/v2.1/servers/a331902f-10a9-4bca-bffb-8750e5f1a595" status: 200 len: 1219 microversion: 2.1 time: 0.100349 May 19 21:35:32.363477 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 191/387] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:35:32 2022] GET /compute/v2.1/servers/a331902f-10a9-4bca-bffb-8750e5f1a595 => generated 1219 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:35:32.500856 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-b9fae579-f2d2-429b-8bd1-4c1ad6b7a664 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a58f82117ab437cab5607c204c86547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4951b93f86e1485692a4aae7b9ece8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:35:32.509251 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-b9fae579-f2d2-429b-8bd1-4c1ad6b7a664 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] 10.222.0.65 "GET /compute/v2.1/servers/6442f189-c760-45c5-8313-4f1d3fe46461" status: 200 len: 1267 microversion: 2.1 time: 0.175023 May 19 21:35:32.509869 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 197/388] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:35:32 2022] GET /compute/v2.1/servers/6442f189-c760-45c5-8313-4f1d3fe46461 => generated 1267 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 21:35:32.589401 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-a3ba166e-7eff-4b04-8d99-c1cfd348a6db tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:35:32.590373 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-a3ba166e-7eff-4b04-8d99-c1cfd348a6db tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] [instance: 8b820379-bb78-465a-a84d-7c1e945c74da] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:35:32.597055 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a3ba166e-7eff-4b04-8d99-c1cfd348a6db tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:32.597502 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a3ba166e-7eff-4b04-8d99-c1cfd348a6db tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:32.598291 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a3ba166e-7eff-4b04-8d99-c1cfd348a6db tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:32.598748 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a3ba166e-7eff-4b04-8d99-c1cfd348a6db tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:32.664846 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-a3ba166e-7eff-4b04-8d99-c1cfd348a6db tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ad8b76baf294f91bc4c641280ab03f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '120a6c484bec4e52bc5891c927647e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:35:32.673620 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-a3ba166e-7eff-4b04-8d99-c1cfd348a6db tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] 10.222.0.65 "GET /compute/v2.1/servers/8b820379-bb78-465a-a84d-7c1e945c74da" status: 200 len: 1222 microversion: 2.1 time: 0.087960 May 19 21:35:32.674128 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 192/389] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:35:32 2022] GET /compute/v2.1/servers/8b820379-bb78-465a-a84d-7c1e945c74da => generated 1222 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:35:32.822321 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-ce7f321b-08e4-4a71-9c02-32d40cdfda02 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:35:32.822964 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-ce7f321b-08e4-4a71-9c02-32d40cdfda02 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] [instance: 89cb2230-d75e-4c8c-b47b-83f1698654dd] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:35:32.831663 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ce7f321b-08e4-4a71-9c02-32d40cdfda02 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:32.832147 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ce7f321b-08e4-4a71-9c02-32d40cdfda02 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:32.833072 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ce7f321b-08e4-4a71-9c02-32d40cdfda02 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:32.833375 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ce7f321b-08e4-4a71-9c02-32d40cdfda02 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:32.983124 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-ce7f321b-08e4-4a71-9c02-32d40cdfda02 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1664dba0cd9b4d9da1e4b78691b8567e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fcf03712c6f4926a2a95dfd0519536a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:35:32.988197 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-ce7f321b-08e4-4a71-9c02-32d40cdfda02 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] 10.222.0.65 "GET /compute/v2.1/servers/89cb2230-d75e-4c8c-b47b-83f1698654dd" status: 200 len: 1358 microversion: 2.1 time: 0.169746 May 19 21:35:32.988773 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 198/390] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:35:32 2022] GET /compute/v2.1/servers/89cb2230-d75e-4c8c-b47b-83f1698654dd => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:35:33.382969 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-1069e35c-bea6-4e27-81e1-03b1a3b4a95e tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:35:33.383573 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-1069e35c-bea6-4e27-81e1-03b1a3b4a95e tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] [instance: a331902f-10a9-4bca-bffb-8750e5f1a595] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:35:33.390474 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1069e35c-bea6-4e27-81e1-03b1a3b4a95e tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:33.390916 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1069e35c-bea6-4e27-81e1-03b1a3b4a95e tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:33.391678 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1069e35c-bea6-4e27-81e1-03b1a3b4a95e tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:33.392093 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1069e35c-bea6-4e27-81e1-03b1a3b4a95e tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:33.457003 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-1069e35c-bea6-4e27-81e1-03b1a3b4a95e tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4113ddb776d144f0ae2bb2b7d28e775a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c887b19b903a4702b2812ef9b5b88ddc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:35:33.465631 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-1069e35c-bea6-4e27-81e1-03b1a3b4a95e tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] 10.222.0.65 "GET /compute/v2.1/servers/a331902f-10a9-4bca-bffb-8750e5f1a595" status: 200 len: 1219 microversion: 2.1 time: 0.086511 May 19 21:35:33.466232 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 193/391] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:35:33 2022] GET /compute/v2.1/servers/a331902f-10a9-4bca-bffb-8750e5f1a595 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:35:33.527370 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-fd7109cc-b420-45f6-9bb9-b53efa40b013 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:35:33.528118 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-fd7109cc-b420-45f6-9bb9-b53efa40b013 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] [instance: 6442f189-c760-45c5-8313-4f1d3fe46461] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:35:33.535015 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-fd7109cc-b420-45f6-9bb9-b53efa40b013 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:33.535489 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-fd7109cc-b420-45f6-9bb9-b53efa40b013 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:33.536256 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-fd7109cc-b420-45f6-9bb9-b53efa40b013 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:33.536685 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-fd7109cc-b420-45f6-9bb9-b53efa40b013 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:33.683066 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-fd7109cc-b420-45f6-9bb9-b53efa40b013 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a58f82117ab437cab5607c204c86547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4951b93f86e1485692a4aae7b9ece8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:35:33.691122 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-fd7109cc-b420-45f6-9bb9-b53efa40b013 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] 10.222.0.65 "GET /compute/v2.1/servers/6442f189-c760-45c5-8313-4f1d3fe46461" status: 200 len: 1267 microversion: 2.1 time: 0.167563 May 19 21:35:33.691594 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-8da2030e-a3b8-42ce-b8d4-78ab547ddb7d tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:35:33.692052 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 199/392] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:35:33 2022] GET /compute/v2.1/servers/6442f189-c760-45c5-8313-4f1d3fe46461 => generated 1267 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:35:33.692219 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-8da2030e-a3b8-42ce-b8d4-78ab547ddb7d tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] [instance: 8b820379-bb78-465a-a84d-7c1e945c74da] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:35:33.698843 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-8da2030e-a3b8-42ce-b8d4-78ab547ddb7d tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:33.699302 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-8da2030e-a3b8-42ce-b8d4-78ab547ddb7d tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:33.700402 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-8da2030e-a3b8-42ce-b8d4-78ab547ddb7d tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:33.701023 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-8da2030e-a3b8-42ce-b8d4-78ab547ddb7d tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:34.005500 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-b79cd0d6-dc46-4fda-88b7-5178df48f965 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:35:34.006117 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-b79cd0d6-dc46-4fda-88b7-5178df48f965 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] [instance: 89cb2230-d75e-4c8c-b47b-83f1698654dd] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:35:34.015211 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b79cd0d6-dc46-4fda-88b7-5178df48f965 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:34.015878 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b79cd0d6-dc46-4fda-88b7-5178df48f965 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:34.016710 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b79cd0d6-dc46-4fda-88b7-5178df48f965 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:34.017116 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b79cd0d6-dc46-4fda-88b7-5178df48f965 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:34.018268 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-8da2030e-a3b8-42ce-b8d4-78ab547ddb7d tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ad8b76baf294f91bc4c641280ab03f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '120a6c484bec4e52bc5891c927647e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:35:34.026573 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-8da2030e-a3b8-42ce-b8d4-78ab547ddb7d tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] 10.222.0.65 "GET /compute/v2.1/servers/8b820379-bb78-465a-a84d-7c1e945c74da" status: 200 len: 1222 microversion: 2.1 time: 0.338726 May 19 21:35:34.027152 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 194/393] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:35:33 2022] GET /compute/v2.1/servers/8b820379-bb78-465a-a84d-7c1e945c74da => generated 1222 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 21:35:34.168539 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-b79cd0d6-dc46-4fda-88b7-5178df48f965 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1664dba0cd9b4d9da1e4b78691b8567e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fcf03712c6f4926a2a95dfd0519536a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:35:34.180049 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-b79cd0d6-dc46-4fda-88b7-5178df48f965 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] 10.222.0.65 "GET /compute/v2.1/servers/89cb2230-d75e-4c8c-b47b-83f1698654dd" status: 200 len: 1358 microversion: 2.1 time: 0.178594 May 19 21:35:34.190867 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 200/394] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:35:34 2022] GET /compute/v2.1/servers/89cb2230-d75e-4c8c-b47b-83f1698654dd => generated 1358 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:35:34.482810 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-5b16758b-293e-416a-8565-c864ef33b91e tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:35:34.483454 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-5b16758b-293e-416a-8565-c864ef33b91e tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] [instance: a331902f-10a9-4bca-bffb-8750e5f1a595] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:35:34.490162 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-5b16758b-293e-416a-8565-c864ef33b91e tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:34.490645 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-5b16758b-293e-416a-8565-c864ef33b91e tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:34.491426 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-5b16758b-293e-416a-8565-c864ef33b91e tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:34.491852 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-5b16758b-293e-416a-8565-c864ef33b91e tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:34.562164 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-5b16758b-293e-416a-8565-c864ef33b91e tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4113ddb776d144f0ae2bb2b7d28e775a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c887b19b903a4702b2812ef9b5b88ddc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:35:34.574320 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-5b16758b-293e-416a-8565-c864ef33b91e tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] 10.222.0.65 "GET /compute/v2.1/servers/a331902f-10a9-4bca-bffb-8750e5f1a595" status: 200 len: 1267 microversion: 2.1 time: 0.095145 May 19 21:35:34.575877 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 195/395] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:35:34 2022] GET /compute/v2.1/servers/a331902f-10a9-4bca-bffb-8750e5f1a595 => generated 1267 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:35:34.708618 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-8351cd29-dba9-4fba-af18-743aab9903f5 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:35:34.709270 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-8351cd29-dba9-4fba-af18-743aab9903f5 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] [instance: 6442f189-c760-45c5-8313-4f1d3fe46461] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:35:34.711403 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell0:SELECT=2 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:35:34.718053 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8351cd29-dba9-4fba-af18-743aab9903f5 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:34.718581 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8351cd29-dba9-4fba-af18-743aab9903f5 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:34.719363 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8351cd29-dba9-4fba-af18-743aab9903f5 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:34.719794 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8351cd29-dba9-4fba-af18-743aab9903f5 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:34.868778 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-8351cd29-dba9-4fba-af18-743aab9903f5 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a58f82117ab437cab5607c204c86547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4951b93f86e1485692a4aae7b9ece8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:35:34.882632 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-8351cd29-dba9-4fba-af18-743aab9903f5 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] 10.222.0.65 "GET /compute/v2.1/servers/6442f189-c760-45c5-8313-4f1d3fe46461" status: 200 len: 1267 microversion: 2.1 time: 0.176849 May 19 21:35:34.885076 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 201/396] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:35:34 2022] GET /compute/v2.1/servers/6442f189-c760-45c5-8313-4f1d3fe46461 => generated 1267 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:35:35.043992 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-e10d8f13-2778-4bb9-a793-3a7cc43ade1b tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:35:35.045074 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-e10d8f13-2778-4bb9-a793-3a7cc43ade1b tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] [instance: 8b820379-bb78-465a-a84d-7c1e945c74da] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:35:35.053371 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e10d8f13-2778-4bb9-a793-3a7cc43ade1b tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:35.054181 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e10d8f13-2778-4bb9-a793-3a7cc43ade1b tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:35.055217 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e10d8f13-2778-4bb9-a793-3a7cc43ade1b tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:35.055837 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e10d8f13-2778-4bb9-a793-3a7cc43ade1b tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:35.126874 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-e10d8f13-2778-4bb9-a793-3a7cc43ade1b tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ad8b76baf294f91bc4c641280ab03f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '120a6c484bec4e52bc5891c927647e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:35:35.135965 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-e10d8f13-2778-4bb9-a793-3a7cc43ade1b tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] 10.222.0.65 "GET /compute/v2.1/servers/8b820379-bb78-465a-a84d-7c1e945c74da" status: 200 len: 1278 microversion: 2.1 time: 0.096590 May 19 21:35:35.136611 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 196/397] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:35:35 2022] GET /compute/v2.1/servers/8b820379-bb78-465a-a84d-7c1e945c74da => generated 1278 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:35:35.197847 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-2b98f818-91af-42a0-9c44-50e345bbb06d tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:35:35.198486 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-2b98f818-91af-42a0-9c44-50e345bbb06d tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] [instance: 89cb2230-d75e-4c8c-b47b-83f1698654dd] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:35:35.206551 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2b98f818-91af-42a0-9c44-50e345bbb06d tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:35.207255 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2b98f818-91af-42a0-9c44-50e345bbb06d tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:35.208277 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2b98f818-91af-42a0-9c44-50e345bbb06d tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:35.208988 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2b98f818-91af-42a0-9c44-50e345bbb06d tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:35.217188 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell1:SELECT=100 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:35:35.383542 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-2b98f818-91af-42a0-9c44-50e345bbb06d tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1664dba0cd9b4d9da1e4b78691b8567e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fcf03712c6f4926a2a95dfd0519536a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:35:35.391583 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-2b98f818-91af-42a0-9c44-50e345bbb06d tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] 10.222.0.65 "GET /compute/v2.1/servers/89cb2230-d75e-4c8c-b47b-83f1698654dd" status: 200 len: 1358 microversion: 2.1 time: 0.197610 May 19 21:35:35.392153 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 202/398] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:35:35 2022] GET /compute/v2.1/servers/89cb2230-d75e-4c8c-b47b-83f1698654dd => generated 1358 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:35:35.592320 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-c42f19f9-9996-412e-ba18-f9dca612d5b2 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:35:35.592911 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-c42f19f9-9996-412e-ba18-f9dca612d5b2 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] [instance: a331902f-10a9-4bca-bffb-8750e5f1a595] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:35:35.600307 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c42f19f9-9996-412e-ba18-f9dca612d5b2 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:35.600794 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c42f19f9-9996-412e-ba18-f9dca612d5b2 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:35.601601 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c42f19f9-9996-412e-ba18-f9dca612d5b2 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:35.602054 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c42f19f9-9996-412e-ba18-f9dca612d5b2 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:35.675475 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-c42f19f9-9996-412e-ba18-f9dca612d5b2 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4113ddb776d144f0ae2bb2b7d28e775a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c887b19b903a4702b2812ef9b5b88ddc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:35:35.683151 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-c42f19f9-9996-412e-ba18-f9dca612d5b2 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] 10.222.0.65 "GET /compute/v2.1/servers/a331902f-10a9-4bca-bffb-8750e5f1a595" status: 200 len: 1275 microversion: 2.1 time: 0.095109 May 19 21:35:35.683713 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 197/399] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:35:35 2022] GET /compute/v2.1/servers/a331902f-10a9-4bca-bffb-8750e5f1a595 => generated 1275 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:35:35.902557 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-7ec71287-d78b-4415-9da4-c686765a4b0a tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:35:35.903299 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-7ec71287-d78b-4415-9da4-c686765a4b0a tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] [instance: 6442f189-c760-45c5-8313-4f1d3fe46461] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:35:35.910888 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7ec71287-d78b-4415-9da4-c686765a4b0a tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:35.911311 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7ec71287-d78b-4415-9da4-c686765a4b0a tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:35.912079 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7ec71287-d78b-4415-9da4-c686765a4b0a tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:35.912504 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7ec71287-d78b-4415-9da4-c686765a4b0a tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:36.052446 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-7ec71287-d78b-4415-9da4-c686765a4b0a tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a58f82117ab437cab5607c204c86547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4951b93f86e1485692a4aae7b9ece8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:35:36.063020 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-7ec71287-d78b-4415-9da4-c686765a4b0a tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] 10.222.0.65 "GET /compute/v2.1/servers/6442f189-c760-45c5-8313-4f1d3fe46461" status: 200 len: 1267 microversion: 2.1 time: 0.164064 May 19 21:35:36.063779 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 203/400] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:35:35 2022] GET /compute/v2.1/servers/6442f189-c760-45c5-8313-4f1d3fe46461 => generated 1267 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:35:36.153760 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-fdfeaa5f-fbed-4050-8261-3d5fb9c7138c tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:35:36.154469 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-fdfeaa5f-fbed-4050-8261-3d5fb9c7138c tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] [instance: 8b820379-bb78-465a-a84d-7c1e945c74da] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:35:36.161154 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-fdfeaa5f-fbed-4050-8261-3d5fb9c7138c tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:36.161596 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-fdfeaa5f-fbed-4050-8261-3d5fb9c7138c tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:36.162414 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-fdfeaa5f-fbed-4050-8261-3d5fb9c7138c tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:36.162843 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-fdfeaa5f-fbed-4050-8261-3d5fb9c7138c tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:36.179066 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_cell1:SELECT=100 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:35:36.230604 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-fdfeaa5f-fbed-4050-8261-3d5fb9c7138c tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ad8b76baf294f91bc4c641280ab03f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '120a6c484bec4e52bc5891c927647e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:35:36.238791 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-fdfeaa5f-fbed-4050-8261-3d5fb9c7138c tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] 10.222.0.65 "GET /compute/v2.1/servers/8b820379-bb78-465a-a84d-7c1e945c74da" status: 200 len: 1278 microversion: 2.1 time: 0.088816 May 19 21:35:36.239149 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 198/401] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:35:36 2022] GET /compute/v2.1/servers/8b820379-bb78-465a-a84d-7c1e945c74da => generated 1278 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:35:36.409654 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-db1efeb9-b777-4b07-818a-cd77e7df5823 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:35:36.410272 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-db1efeb9-b777-4b07-818a-cd77e7df5823 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] [instance: 89cb2230-d75e-4c8c-b47b-83f1698654dd] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:35:36.417024 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-db1efeb9-b777-4b07-818a-cd77e7df5823 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:36.417466 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-db1efeb9-b777-4b07-818a-cd77e7df5823 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:36.418222 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-db1efeb9-b777-4b07-818a-cd77e7df5823 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:36.418866 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-db1efeb9-b777-4b07-818a-cd77e7df5823 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:36.574512 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-db1efeb9-b777-4b07-818a-cd77e7df5823 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1664dba0cd9b4d9da1e4b78691b8567e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fcf03712c6f4926a2a95dfd0519536a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:35:36.583466 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-db1efeb9-b777-4b07-818a-cd77e7df5823 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] 10.222.0.65 "GET /compute/v2.1/servers/89cb2230-d75e-4c8c-b47b-83f1698654dd" status: 200 len: 1358 microversion: 2.1 time: 0.177495 May 19 21:35:36.584193 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 204/402] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:35:36 2022] GET /compute/v2.1/servers/89cb2230-d75e-4c8c-b47b-83f1698654dd => generated 1358 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:35:36.700731 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-7d2ee5ad-aa3c-4e15-ac47-ec4dffb6070e tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:35:36.701334 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-7d2ee5ad-aa3c-4e15-ac47-ec4dffb6070e tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] [instance: a331902f-10a9-4bca-bffb-8750e5f1a595] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:35:36.708006 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-7d2ee5ad-aa3c-4e15-ac47-ec4dffb6070e tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:36.708445 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-7d2ee5ad-aa3c-4e15-ac47-ec4dffb6070e tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:36.709207 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-7d2ee5ad-aa3c-4e15-ac47-ec4dffb6070e tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:36.709649 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-7d2ee5ad-aa3c-4e15-ac47-ec4dffb6070e tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:36.781233 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-7d2ee5ad-aa3c-4e15-ac47-ec4dffb6070e tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4113ddb776d144f0ae2bb2b7d28e775a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c887b19b903a4702b2812ef9b5b88ddc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:35:36.788962 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-7d2ee5ad-aa3c-4e15-ac47-ec4dffb6070e tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] 10.222.0.65 "GET /compute/v2.1/servers/a331902f-10a9-4bca-bffb-8750e5f1a595" status: 200 len: 1275 microversion: 2.1 time: 0.092081 May 19 21:35:36.789542 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 199/403] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:35:36 2022] GET /compute/v2.1/servers/a331902f-10a9-4bca-bffb-8750e5f1a595 => generated 1275 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:35:37.083501 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-cc81323b-08dd-48aa-96c2-6034e5387076 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:35:37.084003 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-cc81323b-08dd-48aa-96c2-6034e5387076 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] [instance: 6442f189-c760-45c5-8313-4f1d3fe46461] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:35:37.091275 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cc81323b-08dd-48aa-96c2-6034e5387076 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:37.091755 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cc81323b-08dd-48aa-96c2-6034e5387076 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:37.092549 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cc81323b-08dd-48aa-96c2-6034e5387076 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:37.092950 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cc81323b-08dd-48aa-96c2-6034e5387076 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:37.238134 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-cc81323b-08dd-48aa-96c2-6034e5387076 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a58f82117ab437cab5607c204c86547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4951b93f86e1485692a4aae7b9ece8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:35:37.246081 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-cc81323b-08dd-48aa-96c2-6034e5387076 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] 10.222.0.65 "GET /compute/v2.1/servers/6442f189-c760-45c5-8313-4f1d3fe46461" status: 200 len: 1267 microversion: 2.1 time: 0.166563 May 19 21:35:37.246969 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 205/404] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:35:37 2022] GET /compute/v2.1/servers/6442f189-c760-45c5-8313-4f1d3fe46461 => generated 1267 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:35:37.260351 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-e2699aa5-725d-4cdd-9ff9-c2bb9e4adf14 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:35:37.260968 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-e2699aa5-725d-4cdd-9ff9-c2bb9e4adf14 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] [instance: 8b820379-bb78-465a-a84d-7c1e945c74da] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:35:37.267518 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e2699aa5-725d-4cdd-9ff9-c2bb9e4adf14 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:37.267973 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e2699aa5-725d-4cdd-9ff9-c2bb9e4adf14 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:37.268771 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e2699aa5-725d-4cdd-9ff9-c2bb9e4adf14 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:37.269201 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e2699aa5-725d-4cdd-9ff9-c2bb9e4adf14 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:37.336405 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-e2699aa5-725d-4cdd-9ff9-c2bb9e4adf14 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ad8b76baf294f91bc4c641280ab03f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '120a6c484bec4e52bc5891c927647e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:35:37.344359 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-e2699aa5-725d-4cdd-9ff9-c2bb9e4adf14 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] 10.222.0.65 "GET /compute/v2.1/servers/8b820379-bb78-465a-a84d-7c1e945c74da" status: 200 len: 1278 microversion: 2.1 time: 0.089025 May 19 21:35:37.344937 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 200/405] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:35:37 2022] GET /compute/v2.1/servers/8b820379-bb78-465a-a84d-7c1e945c74da => generated 1278 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:35:37.602635 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-92da885d-ca45-4b04-a45e-b10a192927a4 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:35:37.603271 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-92da885d-ca45-4b04-a45e-b10a192927a4 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] [instance: 89cb2230-d75e-4c8c-b47b-83f1698654dd] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:35:37.611131 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-92da885d-ca45-4b04-a45e-b10a192927a4 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:37.611539 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-92da885d-ca45-4b04-a45e-b10a192927a4 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:37.612357 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-92da885d-ca45-4b04-a45e-b10a192927a4 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:37.612816 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-92da885d-ca45-4b04-a45e-b10a192927a4 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:37.748837 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-92da885d-ca45-4b04-a45e-b10a192927a4 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1664dba0cd9b4d9da1e4b78691b8567e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fcf03712c6f4926a2a95dfd0519536a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:35:37.756755 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-92da885d-ca45-4b04-a45e-b10a192927a4 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] 10.222.0.65 "GET /compute/v2.1/servers/89cb2230-d75e-4c8c-b47b-83f1698654dd" status: 200 len: 1358 microversion: 2.1 time: 0.158099 May 19 21:35:37.757315 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 206/406] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:35:37 2022] GET /compute/v2.1/servers/89cb2230-d75e-4c8c-b47b-83f1698654dd => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:35:37.806553 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-43494d76-f366-4054-90cc-ca155be75ee9 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:35:37.807163 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-43494d76-f366-4054-90cc-ca155be75ee9 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] [instance: a331902f-10a9-4bca-bffb-8750e5f1a595] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:35:37.814032 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-43494d76-f366-4054-90cc-ca155be75ee9 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:37.814498 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-43494d76-f366-4054-90cc-ca155be75ee9 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:37.815284 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-43494d76-f366-4054-90cc-ca155be75ee9 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:37.815710 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-43494d76-f366-4054-90cc-ca155be75ee9 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:37.887213 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-43494d76-f366-4054-90cc-ca155be75ee9 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4113ddb776d144f0ae2bb2b7d28e775a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c887b19b903a4702b2812ef9b5b88ddc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:35:37.895490 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-43494d76-f366-4054-90cc-ca155be75ee9 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] 10.222.0.65 "GET /compute/v2.1/servers/a331902f-10a9-4bca-bffb-8750e5f1a595" status: 200 len: 1275 microversion: 2.1 time: 0.092734 May 19 21:35:37.896084 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 201/407] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:35:37 2022] GET /compute/v2.1/servers/a331902f-10a9-4bca-bffb-8750e5f1a595 => generated 1275 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:35:38.264165 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-e15ae3a6-5328-4de5-b894-b434316b04d1 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:35:38.264779 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-e15ae3a6-5328-4de5-b894-b434316b04d1 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] [instance: 6442f189-c760-45c5-8313-4f1d3fe46461] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:35:38.271684 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e15ae3a6-5328-4de5-b894-b434316b04d1 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:38.272137 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e15ae3a6-5328-4de5-b894-b434316b04d1 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:38.272950 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e15ae3a6-5328-4de5-b894-b434316b04d1 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:38.273357 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e15ae3a6-5328-4de5-b894-b434316b04d1 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:38.362908 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-3650a122-9a40-4969-bc9c-e683e3fa2b8d tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:35:38.364381 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-3650a122-9a40-4969-bc9c-e683e3fa2b8d tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] [instance: 8b820379-bb78-465a-a84d-7c1e945c74da] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:35:38.371439 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-3650a122-9a40-4969-bc9c-e683e3fa2b8d tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:38.374134 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-3650a122-9a40-4969-bc9c-e683e3fa2b8d tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:38.375102 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-3650a122-9a40-4969-bc9c-e683e3fa2b8d tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:38.375531 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-3650a122-9a40-4969-bc9c-e683e3fa2b8d tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:38.429813 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-e15ae3a6-5328-4de5-b894-b434316b04d1 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a58f82117ab437cab5607c204c86547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4951b93f86e1485692a4aae7b9ece8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:35:38.442569 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-e15ae3a6-5328-4de5-b894-b434316b04d1 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] 10.222.0.65 "GET /compute/v2.1/servers/6442f189-c760-45c5-8313-4f1d3fe46461" status: 200 len: 1267 microversion: 2.1 time: 0.182306 May 19 21:35:38.442984 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 207/408] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:35:38 2022] GET /compute/v2.1/servers/6442f189-c760-45c5-8313-4f1d3fe46461 => generated 1267 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:35:38.469398 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-3650a122-9a40-4969-bc9c-e683e3fa2b8d tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ad8b76baf294f91bc4c641280ab03f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '120a6c484bec4e52bc5891c927647e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:35:38.477796 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-3650a122-9a40-4969-bc9c-e683e3fa2b8d tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] 10.222.0.65 "GET /compute/v2.1/servers/8b820379-bb78-465a-a84d-7c1e945c74da" status: 200 len: 1278 microversion: 2.1 time: 0.119524 May 19 21:35:38.478726 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 202/409] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:35:38 2022] GET /compute/v2.1/servers/8b820379-bb78-465a-a84d-7c1e945c74da => generated 1278 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:35:38.775720 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-a6d3e057-fd5e-48eb-94f9-f4c5e13d6a69 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:35:38.776430 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-a6d3e057-fd5e-48eb-94f9-f4c5e13d6a69 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] [instance: 89cb2230-d75e-4c8c-b47b-83f1698654dd] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:35:38.784194 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a6d3e057-fd5e-48eb-94f9-f4c5e13d6a69 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:38.784636 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a6d3e057-fd5e-48eb-94f9-f4c5e13d6a69 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:38.785422 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a6d3e057-fd5e-48eb-94f9-f4c5e13d6a69 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:38.785848 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a6d3e057-fd5e-48eb-94f9-f4c5e13d6a69 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:38.913618 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-9f6230b0-6902-4efe-a480-2f1e5c0ee9c5 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:35:38.914268 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-9f6230b0-6902-4efe-a480-2f1e5c0ee9c5 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] [instance: a331902f-10a9-4bca-bffb-8750e5f1a595] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:35:38.922276 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-9f6230b0-6902-4efe-a480-2f1e5c0ee9c5 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:38.922745 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-9f6230b0-6902-4efe-a480-2f1e5c0ee9c5 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:38.923623 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-9f6230b0-6902-4efe-a480-2f1e5c0ee9c5 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:38.924057 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-9f6230b0-6902-4efe-a480-2f1e5c0ee9c5 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:38.953887 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-a6d3e057-fd5e-48eb-94f9-f4c5e13d6a69 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1664dba0cd9b4d9da1e4b78691b8567e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fcf03712c6f4926a2a95dfd0519536a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:35:38.962741 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-a6d3e057-fd5e-48eb-94f9-f4c5e13d6a69 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] 10.222.0.65 "GET /compute/v2.1/servers/89cb2230-d75e-4c8c-b47b-83f1698654dd" status: 200 len: 1358 microversion: 2.1 time: 0.191425 May 19 21:35:38.963298 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 208/410] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:35:38 2022] GET /compute/v2.1/servers/89cb2230-d75e-4c8c-b47b-83f1698654dd => generated 1358 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:35:39.015056 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-9f6230b0-6902-4efe-a480-2f1e5c0ee9c5 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4113ddb776d144f0ae2bb2b7d28e775a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c887b19b903a4702b2812ef9b5b88ddc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:35:39.023107 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-9f6230b0-6902-4efe-a480-2f1e5c0ee9c5 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] 10.222.0.65 "GET /compute/v2.1/servers/a331902f-10a9-4bca-bffb-8750e5f1a595" status: 200 len: 1275 microversion: 2.1 time: 0.113716 May 19 21:35:39.023690 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 203/411] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:35:38 2022] GET /compute/v2.1/servers/a331902f-10a9-4bca-bffb-8750e5f1a595 => generated 1275 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:35:39.466475 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-1a90447b-815b-4374-a4f2-1f619c227f30 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:35:39.467167 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-1a90447b-815b-4374-a4f2-1f619c227f30 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] [instance: 6442f189-c760-45c5-8313-4f1d3fe46461] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:35:39.475639 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1a90447b-815b-4374-a4f2-1f619c227f30 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:39.476220 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1a90447b-815b-4374-a4f2-1f619c227f30 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:39.477350 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1a90447b-815b-4374-a4f2-1f619c227f30 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:39.478015 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1a90447b-815b-4374-a4f2-1f619c227f30 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:39.503625 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-c3ccd56c-f838-42b7-8d0d-17b6136755e2 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:35:39.505104 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-c3ccd56c-f838-42b7-8d0d-17b6136755e2 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] [instance: 8b820379-bb78-465a-a84d-7c1e945c74da] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:35:39.512502 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c3ccd56c-f838-42b7-8d0d-17b6136755e2 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:39.512958 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c3ccd56c-f838-42b7-8d0d-17b6136755e2 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:39.513747 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c3ccd56c-f838-42b7-8d0d-17b6136755e2 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:39.514174 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c3ccd56c-f838-42b7-8d0d-17b6136755e2 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:39.694071 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-c3ccd56c-f838-42b7-8d0d-17b6136755e2 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ad8b76baf294f91bc4c641280ab03f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '120a6c484bec4e52bc5891c927647e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:35:39.712910 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-c3ccd56c-f838-42b7-8d0d-17b6136755e2 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] 10.222.0.65 "GET /compute/v2.1/servers/8b820379-bb78-465a-a84d-7c1e945c74da" status: 200 len: 1278 microversion: 2.1 time: 0.216200 May 19 21:35:39.717331 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 204/412] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:35:39 2022] GET /compute/v2.1/servers/8b820379-bb78-465a-a84d-7c1e945c74da => generated 1278 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:35:39.983220 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-6789f4b0-b9f4-4a0c-a381-1abfeb5f90db tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:35:39.983797 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-6789f4b0-b9f4-4a0c-a381-1abfeb5f90db tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] [instance: 89cb2230-d75e-4c8c-b47b-83f1698654dd] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:35:39.991778 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-6789f4b0-b9f4-4a0c-a381-1abfeb5f90db tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:39.992369 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-6789f4b0-b9f4-4a0c-a381-1abfeb5f90db tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:39.993259 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-6789f4b0-b9f4-4a0c-a381-1abfeb5f90db tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:39.993831 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-6789f4b0-b9f4-4a0c-a381-1abfeb5f90db tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:40.241392 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-1a90447b-815b-4374-a4f2-1f619c227f30 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a58f82117ab437cab5607c204c86547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4951b93f86e1485692a4aae7b9ece8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:35:40.252339 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-1a90447b-815b-4374-a4f2-1f619c227f30 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] 10.222.0.65 "GET /compute/v2.1/servers/6442f189-c760-45c5-8313-4f1d3fe46461" status: 200 len: 1267 microversion: 2.1 time: 0.792118 May 19 21:35:40.252935 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 209/413] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:35:39 2022] GET /compute/v2.1/servers/6442f189-c760-45c5-8313-4f1d3fe46461 => generated 1267 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:35:40.258008 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-b4239199-71fa-4dae-97ef-b6e993ae8ac7 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:35:40.258936 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-b4239199-71fa-4dae-97ef-b6e993ae8ac7 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] [instance: a331902f-10a9-4bca-bffb-8750e5f1a595] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:35:40.266718 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b4239199-71fa-4dae-97ef-b6e993ae8ac7 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:40.267532 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b4239199-71fa-4dae-97ef-b6e993ae8ac7 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:40.268799 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b4239199-71fa-4dae-97ef-b6e993ae8ac7 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:40.269421 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b4239199-71fa-4dae-97ef-b6e993ae8ac7 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:40.360981 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-b4239199-71fa-4dae-97ef-b6e993ae8ac7 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4113ddb776d144f0ae2bb2b7d28e775a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c887b19b903a4702b2812ef9b5b88ddc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:35:40.361448 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-6789f4b0-b9f4-4a0c-a381-1abfeb5f90db tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1664dba0cd9b4d9da1e4b78691b8567e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fcf03712c6f4926a2a95dfd0519536a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:35:40.375379 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-b4239199-71fa-4dae-97ef-b6e993ae8ac7 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] 10.222.0.65 "GET /compute/v2.1/servers/a331902f-10a9-4bca-bffb-8750e5f1a595" status: 200 len: 1273 microversion: 2.1 time: 0.120804 May 19 21:35:40.376770 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 210/414] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:35:40 2022] GET /compute/v2.1/servers/a331902f-10a9-4bca-bffb-8750e5f1a595 => generated 1273 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:35:40.379412 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-6789f4b0-b9f4-4a0c-a381-1abfeb5f90db tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] 10.222.0.65 "GET /compute/v2.1/servers/89cb2230-d75e-4c8c-b47b-83f1698654dd" status: 200 len: 1358 microversion: 2.1 time: 0.401670 May 19 21:35:40.381462 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 205/415] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:35:39 2022] GET /compute/v2.1/servers/89cb2230-d75e-4c8c-b47b-83f1698654dd => generated 1358 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:35:40.745586 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-8529d4ff-ee01-42fb-8266-63bcc5700e64 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:35:40.747176 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-8529d4ff-ee01-42fb-8266-63bcc5700e64 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] [instance: 8b820379-bb78-465a-a84d-7c1e945c74da] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:35:40.751379 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_api:SELECT=80 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:35:40.763544 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8529d4ff-ee01-42fb-8266-63bcc5700e64 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:40.772991 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [req-51ecc827-21f3-4107-803e-b5e019512838 req-982b163a-82d4-4e13-8a00-97245d564e83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89cb2230-d75e-4c8c-b47b-83f1698654dd", "name": "network-vif-plugged", "status": "completed", "tag": "c48b591a-ce03-49e5-b5c1-3715c76df0d6"}]} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:35:40.775387 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8529d4ff-ee01-42fb-8266-63bcc5700e64 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:40.778948 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8529d4ff-ee01-42fb-8266-63bcc5700e64 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:40.782762 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8529d4ff-ee01-42fb-8266-63bcc5700e64 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:40.812557 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-51ecc827-21f3-4107-803e-b5e019512838 req-982b163a-82d4-4e13-8a00-97245d564e83 service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:40.813542 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-51ecc827-21f3-4107-803e-b5e019512838 req-982b163a-82d4-4e13-8a00-97245d564e83 service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:40.847439 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.compute.server_external_events [req-51ecc827-21f3-4107-803e-b5e019512838 req-982b163a-82d4-4e13-8a00-97245d564e83 service nova] Creating event network-vif-plugged:c48b591a-ce03-49e5-b5c1-3715c76df0d6 for instance 89cb2230-d75e-4c8c-b47b-83f1698654dd on hv-cinder-83563 May 19 21:35:40.858085 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [req-51ecc827-21f3-4107-803e-b5e019512838 req-982b163a-82d4-4e13-8a00-97245d564e83 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092056 May 19 21:35:40.861309 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 206/416] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 21:35:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 21:35:41.050943 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-8529d4ff-ee01-42fb-8266-63bcc5700e64 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ad8b76baf294f91bc4c641280ab03f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '120a6c484bec4e52bc5891c927647e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:35:41.067351 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-8529d4ff-ee01-42fb-8266-63bcc5700e64 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] 10.222.0.65 "GET /compute/v2.1/servers/8b820379-bb78-465a-a84d-7c1e945c74da" status: 200 len: 1276 microversion: 2.1 time: 0.329068 May 19 21:35:41.069449 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 211/417] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:35:40 2022] GET /compute/v2.1/servers/8b820379-bb78-465a-a84d-7c1e945c74da => generated 1276 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 21:35:41.279444 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_cell0:SELECT=4 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:35:41.280742 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_cell0:SELECT=14 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:35:41.288712 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-0ebf010d-53e7-408c-97c3-12a3829e5051 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:35:41.290126 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-0ebf010d-53e7-408c-97c3-12a3829e5051 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] [instance: 6442f189-c760-45c5-8313-4f1d3fe46461] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:35:41.300511 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-0ebf010d-53e7-408c-97c3-12a3829e5051 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:41.301951 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-0ebf010d-53e7-408c-97c3-12a3829e5051 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:41.302893 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-0ebf010d-53e7-408c-97c3-12a3829e5051 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:41.303338 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-0ebf010d-53e7-408c-97c3-12a3829e5051 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:41.410536 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-b2df1d1c-9b20-4fcf-9f50-fae1ea96da43 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:35:41.411806 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-b2df1d1c-9b20-4fcf-9f50-fae1ea96da43 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] [instance: 89cb2230-d75e-4c8c-b47b-83f1698654dd] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:35:41.424558 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b2df1d1c-9b20-4fcf-9f50-fae1ea96da43 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:41.425470 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b2df1d1c-9b20-4fcf-9f50-fae1ea96da43 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:41.427116 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b2df1d1c-9b20-4fcf-9f50-fae1ea96da43 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:41.428006 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b2df1d1c-9b20-4fcf-9f50-fae1ea96da43 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:41.489916 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-0ebf010d-53e7-408c-97c3-12a3829e5051 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a58f82117ab437cab5607c204c86547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4951b93f86e1485692a4aae7b9ece8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:35:41.498792 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-0ebf010d-53e7-408c-97c3-12a3829e5051 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] 10.222.0.65 "GET /compute/v2.1/servers/6442f189-c760-45c5-8313-4f1d3fe46461" status: 200 len: 1453 microversion: 2.1 time: 0.221326 May 19 21:35:41.499378 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 207/418] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:35:41 2022] GET /compute/v2.1/servers/6442f189-c760-45c5-8313-4f1d3fe46461 => generated 1453 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 21:35:41.504287 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-b2d0aaf2-5a9c-4b78-868e-4854723f0caa tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:35:41.505160 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-b2d0aaf2-5a9c-4b78-868e-4854723f0caa tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] [instance: a331902f-10a9-4bca-bffb-8750e5f1a595] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:35:41.512676 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-b2d0aaf2-5a9c-4b78-868e-4854723f0caa tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:41.513419 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-b2d0aaf2-5a9c-4b78-868e-4854723f0caa tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:41.514223 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-b2d0aaf2-5a9c-4b78-868e-4854723f0caa tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:41.514690 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-b2d0aaf2-5a9c-4b78-868e-4854723f0caa tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:41.604651 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-b2d0aaf2-5a9c-4b78-868e-4854723f0caa tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4113ddb776d144f0ae2bb2b7d28e775a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c887b19b903a4702b2812ef9b5b88ddc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:35:41.617514 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-b2d0aaf2-5a9c-4b78-868e-4854723f0caa tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] 10.222.0.65 "GET /compute/v2.1/servers/a331902f-10a9-4bca-bffb-8750e5f1a595" status: 200 len: 1273 microversion: 2.1 time: 0.116604 May 19 21:35:41.619600 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 208/419] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:35:41 2022] GET /compute/v2.1/servers/a331902f-10a9-4bca-bffb-8750e5f1a595 => generated 1273 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:35:41.626496 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-568500e9-ef2b-4fd1-9295-1f40e798c3cb tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:35:41.628074 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-568500e9-ef2b-4fd1-9295-1f40e798c3cb tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] [instance: 6442f189-c760-45c5-8313-4f1d3fe46461] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:35:41.638196 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-568500e9-ef2b-4fd1-9295-1f40e798c3cb tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:41.640134 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-568500e9-ef2b-4fd1-9295-1f40e798c3cb tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:41.641913 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-568500e9-ef2b-4fd1-9295-1f40e798c3cb tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:41.643080 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-568500e9-ef2b-4fd1-9295-1f40e798c3cb tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:41.800991 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-b2df1d1c-9b20-4fcf-9f50-fae1ea96da43 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1664dba0cd9b4d9da1e4b78691b8567e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fcf03712c6f4926a2a95dfd0519536a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:35:41.810783 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-b2df1d1c-9b20-4fcf-9f50-fae1ea96da43 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] 10.222.0.65 "GET /compute/v2.1/servers/89cb2230-d75e-4c8c-b47b-83f1698654dd" status: 200 len: 1358 microversion: 2.1 time: 0.410783 May 19 21:35:41.811354 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 212/420] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:35:41 2022] GET /compute/v2.1/servers/89cb2230-d75e-4c8c-b47b-83f1698654dd => generated 1358 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:35:41.816240 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-568500e9-ef2b-4fd1-9295-1f40e798c3cb tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a58f82117ab437cab5607c204c86547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4951b93f86e1485692a4aae7b9ece8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:35:41.824558 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-568500e9-ef2b-4fd1-9295-1f40e798c3cb tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] 10.222.0.65 "GET /compute/v2.1/servers/6442f189-c760-45c5-8313-4f1d3fe46461" status: 200 len: 1453 microversion: 2.1 time: 0.203454 May 19 21:35:41.825897 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 209/421] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:35:41 2022] GET /compute/v2.1/servers/6442f189-c760-45c5-8313-4f1d3fe46461 => generated 1453 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:35:42.087291 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-24067a3c-799a-48ac-9d56-44b6bebb4ebd tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:35:42.088002 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-24067a3c-799a-48ac-9d56-44b6bebb4ebd tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] [instance: 8b820379-bb78-465a-a84d-7c1e945c74da] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:35:42.095037 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-24067a3c-799a-48ac-9d56-44b6bebb4ebd tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:42.095588 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-24067a3c-799a-48ac-9d56-44b6bebb4ebd tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:42.096434 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-24067a3c-799a-48ac-9d56-44b6bebb4ebd tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:42.097112 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-24067a3c-799a-48ac-9d56-44b6bebb4ebd tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:42.417225 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-24067a3c-799a-48ac-9d56-44b6bebb4ebd tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ad8b76baf294f91bc4c641280ab03f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '120a6c484bec4e52bc5891c927647e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:35:42.427735 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-24067a3c-799a-48ac-9d56-44b6bebb4ebd tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] 10.222.0.65 "GET /compute/v2.1/servers/8b820379-bb78-465a-a84d-7c1e945c74da" status: 200 len: 1318 microversion: 2.1 time: 0.344322 May 19 21:35:42.428651 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 213/422] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:35:42 2022] GET /compute/v2.1/servers/8b820379-bb78-465a-a84d-7c1e945c74da => generated 1318 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:35:42.643053 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-634d102c-0b9d-476b-8e0a-4afd482f1c97 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:35:42.644304 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-634d102c-0b9d-476b-8e0a-4afd482f1c97 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] [instance: a331902f-10a9-4bca-bffb-8750e5f1a595] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:35:42.649551 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:35:42.673441 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-634d102c-0b9d-476b-8e0a-4afd482f1c97 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:42.677587 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-634d102c-0b9d-476b-8e0a-4afd482f1c97 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:42.678706 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-634d102c-0b9d-476b-8e0a-4afd482f1c97 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:42.685765 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-634d102c-0b9d-476b-8e0a-4afd482f1c97 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:42.840494 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-57d08552-f695-409c-8acf-0368302b685d tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:35:42.857327 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-57d08552-f695-409c-8acf-0368302b685d tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] [instance: 89cb2230-d75e-4c8c-b47b-83f1698654dd] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:35:42.876796 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-57d08552-f695-409c-8acf-0368302b685d tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:42.877524 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-57d08552-f695-409c-8acf-0368302b685d tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:42.878688 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-57d08552-f695-409c-8acf-0368302b685d tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:42.879927 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-57d08552-f695-409c-8acf-0368302b685d tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:42.966108 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-634d102c-0b9d-476b-8e0a-4afd482f1c97 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4113ddb776d144f0ae2bb2b7d28e775a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c887b19b903a4702b2812ef9b5b88ddc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:35:42.980458 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-634d102c-0b9d-476b-8e0a-4afd482f1c97 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] 10.222.0.65 "GET /compute/v2.1/servers/a331902f-10a9-4bca-bffb-8750e5f1a595" status: 200 len: 1315 microversion: 2.1 time: 0.343129 May 19 21:35:42.981510 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 210/423] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:35:42 2022] GET /compute/v2.1/servers/a331902f-10a9-4bca-bffb-8750e5f1a595 => generated 1315 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:35:43.253554 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-57d08552-f695-409c-8acf-0368302b685d tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1664dba0cd9b4d9da1e4b78691b8567e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fcf03712c6f4926a2a95dfd0519536a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:35:43.262189 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-57d08552-f695-409c-8acf-0368302b685d tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] 10.222.0.65 "GET /compute/v2.1/servers/89cb2230-d75e-4c8c-b47b-83f1698654dd" status: 200 len: 1358 microversion: 2.1 time: 0.431154 May 19 21:35:43.275632 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 214/424] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:35:42 2022] GET /compute/v2.1/servers/89cb2230-d75e-4c8c-b47b-83f1698654dd => generated 1358 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:35:43.280960 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [req-d3d92d63-88ba-4380-a7c2-eea32b864a74 req-6b0f24e7-d578-467f-9692-c0f11b8b4adb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b820379-bb78-465a-a84d-7c1e945c74da", "tag": "ac2da9c6-dba5-4638-b63a-d637577ccb4a"}]} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:35:43.291447 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-d3d92d63-88ba-4380-a7c2-eea32b864a74 req-6b0f24e7-d578-467f-9692-c0f11b8b4adb service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:43.292218 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-d3d92d63-88ba-4380-a7c2-eea32b864a74 req-6b0f24e7-d578-467f-9692-c0f11b8b4adb service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:43.310592 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.compute.server_external_events [req-d3d92d63-88ba-4380-a7c2-eea32b864a74 req-6b0f24e7-d578-467f-9692-c0f11b8b4adb service nova] Creating event network-changed:ac2da9c6-dba5-4638-b63a-d637577ccb4a for instance 8b820379-bb78-465a-a84d-7c1e945c74da on hv-cinder-83563 May 19 21:35:43.317941 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [req-d3d92d63-88ba-4380-a7c2-eea32b864a74 req-6b0f24e7-d578-467f-9692-c0f11b8b4adb service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040869 May 19 21:35:43.319107 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 211/425] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 21:35:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 21:35:43.448177 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-cfdb2801-4e21-42ad-bc3a-0f73f4dacd75 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:35:43.450740 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-cfdb2801-4e21-42ad-bc3a-0f73f4dacd75 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] [instance: 8b820379-bb78-465a-a84d-7c1e945c74da] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:35:43.480608 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cfdb2801-4e21-42ad-bc3a-0f73f4dacd75 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:43.482116 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cfdb2801-4e21-42ad-bc3a-0f73f4dacd75 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:43.485139 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cfdb2801-4e21-42ad-bc3a-0f73f4dacd75 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:43.485646 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cfdb2801-4e21-42ad-bc3a-0f73f4dacd75 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:43.822033 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-cfdb2801-4e21-42ad-bc3a-0f73f4dacd75 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ad8b76baf294f91bc4c641280ab03f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '120a6c484bec4e52bc5891c927647e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:35:43.841237 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-cfdb2801-4e21-42ad-bc3a-0f73f4dacd75 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] 10.222.0.65 "GET /compute/v2.1/servers/8b820379-bb78-465a-a84d-7c1e945c74da" status: 200 len: 1318 microversion: 2.1 time: 0.398544 May 19 21:35:43.842899 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 215/426] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:35:43 2022] GET /compute/v2.1/servers/8b820379-bb78-465a-a84d-7c1e945c74da => generated 1318 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:35:44.003491 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-112a5d1a-f72f-4a15-97b9-0c8c180b8025 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:35:44.004368 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-112a5d1a-f72f-4a15-97b9-0c8c180b8025 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] [instance: a331902f-10a9-4bca-bffb-8750e5f1a595] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:35:44.031910 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-112a5d1a-f72f-4a15-97b9-0c8c180b8025 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:44.033662 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-112a5d1a-f72f-4a15-97b9-0c8c180b8025 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:44.038281 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-112a5d1a-f72f-4a15-97b9-0c8c180b8025 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:44.039401 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-112a5d1a-f72f-4a15-97b9-0c8c180b8025 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:44.284112 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-fc9e1cb2-2a34-4d16-bba6-508b53418559 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:35:44.295266 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-fc9e1cb2-2a34-4d16-bba6-508b53418559 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] [instance: 89cb2230-d75e-4c8c-b47b-83f1698654dd] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:35:44.319046 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-fc9e1cb2-2a34-4d16-bba6-508b53418559 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:44.320443 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-fc9e1cb2-2a34-4d16-bba6-508b53418559 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:44.321903 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-fc9e1cb2-2a34-4d16-bba6-508b53418559 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:44.326284 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-fc9e1cb2-2a34-4d16-bba6-508b53418559 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:44.629015 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-112a5d1a-f72f-4a15-97b9-0c8c180b8025 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4113ddb776d144f0ae2bb2b7d28e775a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c887b19b903a4702b2812ef9b5b88ddc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:35:44.644101 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-112a5d1a-f72f-4a15-97b9-0c8c180b8025 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] 10.222.0.65 "GET /compute/v2.1/servers/a331902f-10a9-4bca-bffb-8750e5f1a595" status: 200 len: 1315 microversion: 2.1 time: 0.647536 May 19 21:35:44.645217 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 212/427] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:35:43 2022] GET /compute/v2.1/servers/a331902f-10a9-4bca-bffb-8750e5f1a595 => generated 1315 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:35:44.650177 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [req-1f6abc65-5290-4a84-89a3-efba300a75fe req-98f7bac5-af29-4d09-87c9-7130b04bb2bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6442f189-c760-45c5-8313-4f1d3fe46461", "tag": "2963a31a-a224-4676-b867-1f60fa8904c2"}]} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:35:44.660968 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-1f6abc65-5290-4a84-89a3-efba300a75fe req-98f7bac5-af29-4d09-87c9-7130b04bb2bb service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:44.661500 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-1f6abc65-5290-4a84-89a3-efba300a75fe req-98f7bac5-af29-4d09-87c9-7130b04bb2bb service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:44.674210 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.compute.server_external_events [req-1f6abc65-5290-4a84-89a3-efba300a75fe req-98f7bac5-af29-4d09-87c9-7130b04bb2bb service nova] Creating event network-changed:2963a31a-a224-4676-b867-1f60fa8904c2 for instance 6442f189-c760-45c5-8313-4f1d3fe46461 on hv-cinder-83563 May 19 21:35:44.680999 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [req-1f6abc65-5290-4a84-89a3-efba300a75fe req-98f7bac5-af29-4d09-87c9-7130b04bb2bb service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033892 May 19 21:35:44.681964 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 213/428] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 21:35:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 21:35:44.744272 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-fc9e1cb2-2a34-4d16-bba6-508b53418559 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1664dba0cd9b4d9da1e4b78691b8567e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fcf03712c6f4926a2a95dfd0519536a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:35:44.762791 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-fc9e1cb2-2a34-4d16-bba6-508b53418559 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] 10.222.0.65 "GET /compute/v2.1/servers/89cb2230-d75e-4c8c-b47b-83f1698654dd" status: 200 len: 1548 microversion: 2.1 time: 0.483262 May 19 21:35:44.765477 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 216/429] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:35:44 2022] GET /compute/v2.1/servers/89cb2230-d75e-4c8c-b47b-83f1698654dd => generated 1548 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:35:44.791299 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-0e74c1d8-2182-4200-91e1-0c0b43cfb252 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:35:44.793031 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-0e74c1d8-2182-4200-91e1-0c0b43cfb252 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] [instance: 89cb2230-d75e-4c8c-b47b-83f1698654dd] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:35:44.809506 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-0e74c1d8-2182-4200-91e1-0c0b43cfb252 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:44.810922 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-0e74c1d8-2182-4200-91e1-0c0b43cfb252 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:44.812850 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-0e74c1d8-2182-4200-91e1-0c0b43cfb252 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:44.814127 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-0e74c1d8-2182-4200-91e1-0c0b43cfb252 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:44.867398 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-5aed6da1-56e8-4024-9c21-0ef2d6c318d5 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:35:44.868913 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-5aed6da1-56e8-4024-9c21-0ef2d6c318d5 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] [instance: 8b820379-bb78-465a-a84d-7c1e945c74da] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:35:44.876951 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5aed6da1-56e8-4024-9c21-0ef2d6c318d5 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:44.877599 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5aed6da1-56e8-4024-9c21-0ef2d6c318d5 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:44.878794 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5aed6da1-56e8-4024-9c21-0ef2d6c318d5 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:44.879394 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5aed6da1-56e8-4024-9c21-0ef2d6c318d5 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:45.056668 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-0e74c1d8-2182-4200-91e1-0c0b43cfb252 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1664dba0cd9b4d9da1e4b78691b8567e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fcf03712c6f4926a2a95dfd0519536a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:35:45.075215 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-0e74c1d8-2182-4200-91e1-0c0b43cfb252 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] 10.222.0.65 "GET /compute/v2.1/servers/89cb2230-d75e-4c8c-b47b-83f1698654dd" status: 200 len: 1548 microversion: 2.1 time: 0.291198 May 19 21:35:45.087677 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 214/430] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:35:44 2022] GET /compute/v2.1/servers/89cb2230-d75e-4c8c-b47b-83f1698654dd => generated 1548 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:35:45.094814 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-7e76c261-1e12-416a-9817-938546f45076 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:35:45.101827 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-7e76c261-1e12-416a-9817-938546f45076 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1664dba0cd9b4d9da1e4b78691b8567e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fcf03712c6f4926a2a95dfd0519536a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:35:45.103497 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-7e76c261-1e12-416a-9817-938546f45076 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Searching by: {'deleted': False, 'project_id': '3fcf03712c6f4926a2a95dfd0519536a'} {{(pid=124349) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 19 21:35:45.113261 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-7e76c261-1e12-416a-9817-938546f45076 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:45.114010 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-7e76c261-1e12-416a-9817-938546f45076 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:45.115064 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-7e76c261-1e12-416a-9817-938546f45076 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:45.115692 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-7e76c261-1e12-416a-9817-938546f45076 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:45.226388 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-5aed6da1-56e8-4024-9c21-0ef2d6c318d5 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ad8b76baf294f91bc4c641280ab03f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '120a6c484bec4e52bc5891c927647e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:35:45.238480 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.multi_cell_list [None req-7e76c261-1e12-416a-9817-938546f45076 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=124349) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 19 21:35:45.242729 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-5aed6da1-56e8-4024-9c21-0ef2d6c318d5 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] 10.222.0.65 "GET /compute/v2.1/servers/8b820379-bb78-465a-a84d-7c1e945c74da" status: 200 len: 1318 microversion: 2.1 time: 0.380708 May 19 21:35:45.244976 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 217/431] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:35:44 2022] GET /compute/v2.1/servers/8b820379-bb78-465a-a84d-7c1e945c74da => generated 1318 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 21:35:45.335338 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [req-c2516f04-f864-4c1b-86c2-47354c962ae3 req-3076d8ec-8f45-400f-991d-aff52c4fa53a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a331902f-10a9-4bca-bffb-8750e5f1a595", "tag": "59f66ac2-91ff-4c1a-84e9-ba6ea1689ab2"}]} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:35:45.344182 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-7e76c261-1e12-416a-9817-938546f45076 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] 10.222.0.65 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.254833 May 19 21:35:45.344773 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 215/432] 10.222.0.65 () {58 vars in 1124 bytes} [Thu May 19 21:35:45 2022] GET /compute/v2.1/servers => generated 342 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 21:35:45.349139 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-c2516f04-f864-4c1b-86c2-47354c962ae3 req-3076d8ec-8f45-400f-991d-aff52c4fa53a service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:45.349841 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-c2516f04-f864-4c1b-86c2-47354c962ae3 req-3076d8ec-8f45-400f-991d-aff52c4fa53a service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:45.356065 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-3b0f43b5-c907-41f8-9224-86bec58e6d4f tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:35:45.357322 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-3b0f43b5-c907-41f8-9224-86bec58e6d4f tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] [instance: 89cb2230-d75e-4c8c-b47b-83f1698654dd] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:35:45.363480 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.compute.server_external_events [req-c2516f04-f864-4c1b-86c2-47354c962ae3 req-3076d8ec-8f45-400f-991d-aff52c4fa53a service nova] Creating event network-changed:59f66ac2-91ff-4c1a-84e9-ba6ea1689ab2 for instance a331902f-10a9-4bca-bffb-8750e5f1a595 on hv-cinder-83563 May 19 21:35:45.364676 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-3b0f43b5-c907-41f8-9224-86bec58e6d4f tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:45.366000 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-3b0f43b5-c907-41f8-9224-86bec58e6d4f tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:45.366000 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-3b0f43b5-c907-41f8-9224-86bec58e6d4f tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:45.366486 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-3b0f43b5-c907-41f8-9224-86bec58e6d4f tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:45.369838 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [req-c2516f04-f864-4c1b-86c2-47354c962ae3 req-3076d8ec-8f45-400f-991d-aff52c4fa53a service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037447 May 19 21:35:45.369838 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 218/433] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 21:35:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 21:35:45.526163 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-3b0f43b5-c907-41f8-9224-86bec58e6d4f tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1664dba0cd9b4d9da1e4b78691b8567e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fcf03712c6f4926a2a95dfd0519536a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:35:45.529177 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_cell1:SELECT=100 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:35:45.536136 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-3b0f43b5-c907-41f8-9224-86bec58e6d4f tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] 10.222.0.65 "GET /compute/v2.1/servers/89cb2230-d75e-4c8c-b47b-83f1698654dd" status: 200 len: 1548 microversion: 2.1 time: 0.184279 May 19 21:35:45.537079 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 216/434] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:35:45 2022] GET /compute/v2.1/servers/89cb2230-d75e-4c8c-b47b-83f1698654dd => generated 1548 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:35:45.667873 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-2c3d6e7b-b07f-406e-aae3-425baa6f6a49 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:35:45.670993 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-2c3d6e7b-b07f-406e-aae3-425baa6f6a49 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] [instance: a331902f-10a9-4bca-bffb-8750e5f1a595] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:35:45.682262 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2c3d6e7b-b07f-406e-aae3-425baa6f6a49 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:45.682948 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2c3d6e7b-b07f-406e-aae3-425baa6f6a49 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:45.684931 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2c3d6e7b-b07f-406e-aae3-425baa6f6a49 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:45.685515 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2c3d6e7b-b07f-406e-aae3-425baa6f6a49 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:45.704527 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell1:SELECT=100 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:35:45.847580 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-2c3d6e7b-b07f-406e-aae3-425baa6f6a49 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4113ddb776d144f0ae2bb2b7d28e775a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c887b19b903a4702b2812ef9b5b88ddc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:35:45.859036 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-2c3d6e7b-b07f-406e-aae3-425baa6f6a49 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] 10.222.0.65 "GET /compute/v2.1/servers/a331902f-10a9-4bca-bffb-8750e5f1a595" status: 200 len: 1315 microversion: 2.1 time: 0.199319 May 19 21:35:45.860014 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 219/435] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:35:45 2022] GET /compute/v2.1/servers/a331902f-10a9-4bca-bffb-8750e5f1a595 => generated 1315 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:35:46.263586 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-0fb15736-6040-40c2-8002-2f0a8e83dcd9 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:35:46.264231 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-0fb15736-6040-40c2-8002-2f0a8e83dcd9 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] [instance: 8b820379-bb78-465a-a84d-7c1e945c74da] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:35:46.271014 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-0fb15736-6040-40c2-8002-2f0a8e83dcd9 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:46.271457 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-0fb15736-6040-40c2-8002-2f0a8e83dcd9 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:46.272218 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-0fb15736-6040-40c2-8002-2f0a8e83dcd9 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:46.272644 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-0fb15736-6040-40c2-8002-2f0a8e83dcd9 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:46.420301 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-0fb15736-6040-40c2-8002-2f0a8e83dcd9 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ad8b76baf294f91bc4c641280ab03f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '120a6c484bec4e52bc5891c927647e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:35:46.428027 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-0fb15736-6040-40c2-8002-2f0a8e83dcd9 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] 10.222.0.65 "GET /compute/v2.1/servers/8b820379-bb78-465a-a84d-7c1e945c74da" status: 200 len: 1318 microversion: 2.1 time: 0.168479 May 19 21:35:46.428590 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 217/436] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:35:46 2022] GET /compute/v2.1/servers/8b820379-bb78-465a-a84d-7c1e945c74da => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:35:46.880113 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-e39d6252-b6eb-4814-8e0d-49c95ab8a8ce tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:35:46.880692 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-e39d6252-b6eb-4814-8e0d-49c95ab8a8ce tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] [instance: a331902f-10a9-4bca-bffb-8750e5f1a595] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:35:46.889572 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e39d6252-b6eb-4814-8e0d-49c95ab8a8ce tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:46.890002 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e39d6252-b6eb-4814-8e0d-49c95ab8a8ce tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:46.890794 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e39d6252-b6eb-4814-8e0d-49c95ab8a8ce tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:46.891216 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e39d6252-b6eb-4814-8e0d-49c95ab8a8ce tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:47.029358 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-e39d6252-b6eb-4814-8e0d-49c95ab8a8ce tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4113ddb776d144f0ae2bb2b7d28e775a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c887b19b903a4702b2812ef9b5b88ddc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:35:47.036845 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-e39d6252-b6eb-4814-8e0d-49c95ab8a8ce tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] 10.222.0.65 "GET /compute/v2.1/servers/a331902f-10a9-4bca-bffb-8750e5f1a595" status: 200 len: 1315 microversion: 2.1 time: 0.163068 May 19 21:35:47.037387 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 220/437] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:35:46 2022] GET /compute/v2.1/servers/a331902f-10a9-4bca-bffb-8750e5f1a595 => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:35:47.126948 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-c7a20fa6-b5ff-4806-8b37-119b16bb860e tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c220f89b-8a33-4a71-8af4-b42af759f9d3"}} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:35:47.128082 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-c7a20fa6-b5ff-4806-8b37-119b16bb860e tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] [instance: 89cb2230-d75e-4c8c-b47b-83f1698654dd] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:35:47.134662 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c7a20fa6-b5ff-4806-8b37-119b16bb860e tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:47.135105 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c7a20fa6-b5ff-4806-8b37-119b16bb860e tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:47.135872 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c7a20fa6-b5ff-4806-8b37-119b16bb860e tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:47.136300 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c7a20fa6-b5ff-4806-8b37-119b16bb860e tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:47.445852 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-a441aeed-002b-4718-a4cb-4f4632294066 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:35:47.446390 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-a441aeed-002b-4718-a4cb-4f4632294066 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] [instance: 8b820379-bb78-465a-a84d-7c1e945c74da] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:35:47.453351 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a441aeed-002b-4718-a4cb-4f4632294066 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:47.453799 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a441aeed-002b-4718-a4cb-4f4632294066 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:47.454612 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a441aeed-002b-4718-a4cb-4f4632294066 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:47.455045 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a441aeed-002b-4718-a4cb-4f4632294066 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:47.637205 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-a441aeed-002b-4718-a4cb-4f4632294066 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ad8b76baf294f91bc4c641280ab03f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '120a6c484bec4e52bc5891c927647e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:35:47.646199 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-a441aeed-002b-4718-a4cb-4f4632294066 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] 10.222.0.65 "GET /compute/v2.1/servers/8b820379-bb78-465a-a84d-7c1e945c74da" status: 200 len: 1318 microversion: 2.1 time: 0.204340 May 19 21:35:47.646869 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 221/438] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:35:47 2022] GET /compute/v2.1/servers/8b820379-bb78-465a-a84d-7c1e945c74da => generated 1318 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:35:48.054899 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-b22c0035-df47-425a-89e9-67fbe657e813 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:35:48.055586 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-b22c0035-df47-425a-89e9-67fbe657e813 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] [instance: a331902f-10a9-4bca-bffb-8750e5f1a595] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:35:48.063106 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b22c0035-df47-425a-89e9-67fbe657e813 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:48.063554 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b22c0035-df47-425a-89e9-67fbe657e813 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:48.064375 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b22c0035-df47-425a-89e9-67fbe657e813 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:48.064815 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b22c0035-df47-425a-89e9-67fbe657e813 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:48.217387 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-b22c0035-df47-425a-89e9-67fbe657e813 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4113ddb776d144f0ae2bb2b7d28e775a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c887b19b903a4702b2812ef9b5b88ddc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:35:48.225788 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-b22c0035-df47-425a-89e9-67fbe657e813 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] 10.222.0.65 "GET /compute/v2.1/servers/a331902f-10a9-4bca-bffb-8750e5f1a595" status: 200 len: 1315 microversion: 2.1 time: 0.174770 May 19 21:35:48.226411 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 222/439] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:35:48 2022] GET /compute/v2.1/servers/a331902f-10a9-4bca-bffb-8750e5f1a595 => generated 1315 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:35:48.664819 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-6105b83f-5e4d-40be-9329-d0638addde10 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:35:48.665523 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-6105b83f-5e4d-40be-9329-d0638addde10 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] [instance: 8b820379-bb78-465a-a84d-7c1e945c74da] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:35:48.673558 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6105b83f-5e4d-40be-9329-d0638addde10 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:48.674308 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6105b83f-5e4d-40be-9329-d0638addde10 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:48.675308 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6105b83f-5e4d-40be-9329-d0638addde10 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:48.675950 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6105b83f-5e4d-40be-9329-d0638addde10 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:48.870106 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-6105b83f-5e4d-40be-9329-d0638addde10 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ad8b76baf294f91bc4c641280ab03f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '120a6c484bec4e52bc5891c927647e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:35:48.879110 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-6105b83f-5e4d-40be-9329-d0638addde10 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] 10.222.0.65 "GET /compute/v2.1/servers/8b820379-bb78-465a-a84d-7c1e945c74da" status: 200 len: 1318 microversion: 2.1 time: 0.219429 May 19 21:35:48.879697 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 223/440] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:35:48 2022] GET /compute/v2.1/servers/8b820379-bb78-465a-a84d-7c1e945c74da => generated 1318 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 21:35:49.243090 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-cfd3f8b3-0af6-4540-be3b-1d30e9a7ce87 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:35:49.243898 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-cfd3f8b3-0af6-4540-be3b-1d30e9a7ce87 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] [instance: a331902f-10a9-4bca-bffb-8750e5f1a595] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:35:49.251574 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cfd3f8b3-0af6-4540-be3b-1d30e9a7ce87 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:49.252014 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cfd3f8b3-0af6-4540-be3b-1d30e9a7ce87 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:49.252799 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cfd3f8b3-0af6-4540-be3b-1d30e9a7ce87 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:49.253230 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cfd3f8b3-0af6-4540-be3b-1d30e9a7ce87 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:49.404108 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-cfd3f8b3-0af6-4540-be3b-1d30e9a7ce87 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4113ddb776d144f0ae2bb2b7d28e775a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c887b19b903a4702b2812ef9b5b88ddc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:35:49.412254 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-cfd3f8b3-0af6-4540-be3b-1d30e9a7ce87 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] 10.222.0.65 "GET /compute/v2.1/servers/a331902f-10a9-4bca-bffb-8750e5f1a595" status: 200 len: 1315 microversion: 2.1 time: 0.172960 May 19 21:35:49.412866 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 224/441] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:35:49 2022] GET /compute/v2.1/servers/a331902f-10a9-4bca-bffb-8750e5f1a595 => generated 1315 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:35:49.899580 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-a2b902ae-79d7-4f05-a423-e5c29d9dff3d tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:35:49.900534 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-a2b902ae-79d7-4f05-a423-e5c29d9dff3d tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] [instance: 8b820379-bb78-465a-a84d-7c1e945c74da] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:35:49.909816 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a2b902ae-79d7-4f05-a423-e5c29d9dff3d tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:49.910594 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a2b902ae-79d7-4f05-a423-e5c29d9dff3d tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:49.911839 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a2b902ae-79d7-4f05-a423-e5c29d9dff3d tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:49.912517 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a2b902ae-79d7-4f05-a423-e5c29d9dff3d tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:50.054849 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-a2b902ae-79d7-4f05-a423-e5c29d9dff3d tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ad8b76baf294f91bc4c641280ab03f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '120a6c484bec4e52bc5891c927647e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:35:50.062782 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-a2b902ae-79d7-4f05-a423-e5c29d9dff3d tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] 10.222.0.65 "GET /compute/v2.1/servers/8b820379-bb78-465a-a84d-7c1e945c74da" status: 200 len: 1318 microversion: 2.1 time: 0.169903 May 19 21:35:50.063349 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 225/442] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:35:49 2022] GET /compute/v2.1/servers/8b820379-bb78-465a-a84d-7c1e945c74da => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:35:50.430292 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-680d6aa2-945e-4c9f-9d9e-0f389585a646 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:35:50.431067 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-680d6aa2-945e-4c9f-9d9e-0f389585a646 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] [instance: a331902f-10a9-4bca-bffb-8750e5f1a595] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:35:50.439234 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-680d6aa2-945e-4c9f-9d9e-0f389585a646 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:50.439735 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-680d6aa2-945e-4c9f-9d9e-0f389585a646 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:50.440589 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-680d6aa2-945e-4c9f-9d9e-0f389585a646 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:50.441139 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-680d6aa2-945e-4c9f-9d9e-0f389585a646 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:50.604529 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-680d6aa2-945e-4c9f-9d9e-0f389585a646 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4113ddb776d144f0ae2bb2b7d28e775a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c887b19b903a4702b2812ef9b5b88ddc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:35:50.613160 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-680d6aa2-945e-4c9f-9d9e-0f389585a646 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] 10.222.0.65 "GET /compute/v2.1/servers/a331902f-10a9-4bca-bffb-8750e5f1a595" status: 200 len: 1315 microversion: 2.1 time: 0.186890 May 19 21:35:50.613738 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 226/443] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:35:50 2022] GET /compute/v2.1/servers/a331902f-10a9-4bca-bffb-8750e5f1a595 => generated 1315 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:35:51.080969 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-f58642ee-6b93-44ec-982b-62c71598f8c0 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:35:51.081608 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-f58642ee-6b93-44ec-982b-62c71598f8c0 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] [instance: 8b820379-bb78-465a-a84d-7c1e945c74da] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:35:51.088107 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f58642ee-6b93-44ec-982b-62c71598f8c0 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:51.088548 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f58642ee-6b93-44ec-982b-62c71598f8c0 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:51.089627 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f58642ee-6b93-44ec-982b-62c71598f8c0 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:51.090115 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f58642ee-6b93-44ec-982b-62c71598f8c0 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:51.259311 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-f58642ee-6b93-44ec-982b-62c71598f8c0 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ad8b76baf294f91bc4c641280ab03f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '120a6c484bec4e52bc5891c927647e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:35:51.272240 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-f58642ee-6b93-44ec-982b-62c71598f8c0 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] 10.222.0.65 "GET /compute/v2.1/servers/8b820379-bb78-465a-a84d-7c1e945c74da" status: 200 len: 1318 microversion: 2.1 time: 0.194896 May 19 21:35:51.273389 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 227/444] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:35:51 2022] GET /compute/v2.1/servers/8b820379-bb78-465a-a84d-7c1e945c74da => generated 1318 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 21:35:51.426861 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [req-2f1dc95b-ed00-4097-975e-f794f8dfd895 req-cca9453f-251b-4910-a269-9bea046aa576 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b820379-bb78-465a-a84d-7c1e945c74da", "name": "network-vif-plugged", "status": "completed", "tag": "ac2da9c6-dba5-4638-b63a-d637577ccb4a"}]} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:35:51.439524 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-2f1dc95b-ed00-4097-975e-f794f8dfd895 req-cca9453f-251b-4910-a269-9bea046aa576 service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:51.440390 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-2f1dc95b-ed00-4097-975e-f794f8dfd895 req-cca9453f-251b-4910-a269-9bea046aa576 service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:51.466181 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.compute.server_external_events [req-2f1dc95b-ed00-4097-975e-f794f8dfd895 req-cca9453f-251b-4910-a269-9bea046aa576 service nova] Creating event network-vif-plugged:ac2da9c6-dba5-4638-b63a-d637577ccb4a for instance 8b820379-bb78-465a-a84d-7c1e945c74da on hv-cinder-83563 May 19 21:35:51.475713 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [req-2f1dc95b-ed00-4097-975e-f794f8dfd895 req-cca9453f-251b-4910-a269-9bea046aa576 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053856 May 19 21:35:51.477610 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 228/445] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 21:35:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 21:35:51.632878 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-f14d5e64-f1b0-4077-bf97-f289ece1cdb9 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:35:51.633579 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-f14d5e64-f1b0-4077-bf97-f289ece1cdb9 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] [instance: a331902f-10a9-4bca-bffb-8750e5f1a595] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:35:51.641605 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f14d5e64-f1b0-4077-bf97-f289ece1cdb9 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:51.642043 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f14d5e64-f1b0-4077-bf97-f289ece1cdb9 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:51.642936 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f14d5e64-f1b0-4077-bf97-f289ece1cdb9 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:51.643415 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f14d5e64-f1b0-4077-bf97-f289ece1cdb9 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:51.796040 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-f14d5e64-f1b0-4077-bf97-f289ece1cdb9 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4113ddb776d144f0ae2bb2b7d28e775a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c887b19b903a4702b2812ef9b5b88ddc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:35:51.804471 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-f14d5e64-f1b0-4077-bf97-f289ece1cdb9 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] 10.222.0.65 "GET /compute/v2.1/servers/a331902f-10a9-4bca-bffb-8750e5f1a595" status: 200 len: 1315 microversion: 2.1 time: 0.176650 May 19 21:35:51.805037 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 229/446] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:35:51 2022] GET /compute/v2.1/servers/a331902f-10a9-4bca-bffb-8750e5f1a595 => generated 1315 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:35:52.291003 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-0e6f7233-ff3a-4226-86f8-a48e978d18f4 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:35:52.291622 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-0e6f7233-ff3a-4226-86f8-a48e978d18f4 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] [instance: 8b820379-bb78-465a-a84d-7c1e945c74da] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:35:52.298718 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0e6f7233-ff3a-4226-86f8-a48e978d18f4 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:52.299164 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0e6f7233-ff3a-4226-86f8-a48e978d18f4 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:52.299945 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0e6f7233-ff3a-4226-86f8-a48e978d18f4 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:52.300374 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0e6f7233-ff3a-4226-86f8-a48e978d18f4 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:52.475591 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-0e6f7233-ff3a-4226-86f8-a48e978d18f4 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ad8b76baf294f91bc4c641280ab03f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '120a6c484bec4e52bc5891c927647e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:35:52.497365 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-0e6f7233-ff3a-4226-86f8-a48e978d18f4 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] 10.222.0.65 "GET /compute/v2.1/servers/8b820379-bb78-465a-a84d-7c1e945c74da" status: 200 len: 1318 microversion: 2.1 time: 0.210152 May 19 21:35:52.498372 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 230/447] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:35:52 2022] GET /compute/v2.1/servers/8b820379-bb78-465a-a84d-7c1e945c74da => generated 1318 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:35:52.664225 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-c7a20fa6-b5ff-4806-8b37-119b16bb860e tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] 10.222.0.65 "POST /compute/v2.1/servers/89cb2230-d75e-4c8c-b47b-83f1698654dd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 5.540847 May 19 21:35:52.670172 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 218/448] 10.222.0.65 () {60 vars in 1322 bytes} [Thu May 19 21:35:47 2022] POST /compute/v2.1/servers/89cb2230-d75e-4c8c-b47b-83f1698654dd/os-volume_attachments => generated 194 bytes in 5544 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 21:35:52.822787 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-f125feb8-eebb-4a85-86c7-5234036b2133 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:35:52.823919 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-f125feb8-eebb-4a85-86c7-5234036b2133 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] [instance: a331902f-10a9-4bca-bffb-8750e5f1a595] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:35:52.833853 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f125feb8-eebb-4a85-86c7-5234036b2133 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:52.834330 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f125feb8-eebb-4a85-86c7-5234036b2133 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:52.835263 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f125feb8-eebb-4a85-86c7-5234036b2133 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:52.835778 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f125feb8-eebb-4a85-86c7-5234036b2133 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:52.985954 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-f125feb8-eebb-4a85-86c7-5234036b2133 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4113ddb776d144f0ae2bb2b7d28e775a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c887b19b903a4702b2812ef9b5b88ddc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:35:52.994076 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-f125feb8-eebb-4a85-86c7-5234036b2133 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] 10.222.0.65 "GET /compute/v2.1/servers/a331902f-10a9-4bca-bffb-8750e5f1a595" status: 200 len: 1315 microversion: 2.1 time: 0.176791 May 19 21:35:52.994758 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 231/449] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:35:52 2022] GET /compute/v2.1/servers/a331902f-10a9-4bca-bffb-8750e5f1a595 => generated 1315 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:35:53.515502 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-22de5397-5647-4f90-b91a-96e97a5bfcc7 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:35:53.516224 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-22de5397-5647-4f90-b91a-96e97a5bfcc7 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] [instance: 8b820379-bb78-465a-a84d-7c1e945c74da] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:35:53.523073 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-22de5397-5647-4f90-b91a-96e97a5bfcc7 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:53.523510 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-22de5397-5647-4f90-b91a-96e97a5bfcc7 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:53.524272 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-22de5397-5647-4f90-b91a-96e97a5bfcc7 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:53.524694 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-22de5397-5647-4f90-b91a-96e97a5bfcc7 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:53.702335 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-22de5397-5647-4f90-b91a-96e97a5bfcc7 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ad8b76baf294f91bc4c641280ab03f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '120a6c484bec4e52bc5891c927647e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:35:53.712493 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-22de5397-5647-4f90-b91a-96e97a5bfcc7 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] 10.222.0.65 "GET /compute/v2.1/servers/8b820379-bb78-465a-a84d-7c1e945c74da" status: 200 len: 1318 microversion: 2.1 time: 0.201736 May 19 21:35:53.713258 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 219/450] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:35:53 2022] GET /compute/v2.1/servers/8b820379-bb78-465a-a84d-7c1e945c74da => generated 1318 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:35:54.017439 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-200c1bfd-e3ed-4824-ad5a-2153a7c08fd6 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:35:54.018557 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-200c1bfd-e3ed-4824-ad5a-2153a7c08fd6 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] [instance: a331902f-10a9-4bca-bffb-8750e5f1a595] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:35:54.032492 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-200c1bfd-e3ed-4824-ad5a-2153a7c08fd6 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:54.033493 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-200c1bfd-e3ed-4824-ad5a-2153a7c08fd6 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:54.035019 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-200c1bfd-e3ed-4824-ad5a-2153a7c08fd6 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:54.035843 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-200c1bfd-e3ed-4824-ad5a-2153a7c08fd6 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:54.228584 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-200c1bfd-e3ed-4824-ad5a-2153a7c08fd6 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4113ddb776d144f0ae2bb2b7d28e775a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c887b19b903a4702b2812ef9b5b88ddc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:35:54.237177 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-200c1bfd-e3ed-4824-ad5a-2153a7c08fd6 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] 10.222.0.65 "GET /compute/v2.1/servers/a331902f-10a9-4bca-bffb-8750e5f1a595" status: 200 len: 1315 microversion: 2.1 time: 0.228799 May 19 21:35:54.237767 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 232/451] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:35:54 2022] GET /compute/v2.1/servers/a331902f-10a9-4bca-bffb-8750e5f1a595 => generated 1315 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:35:54.733682 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-4be057b6-b8f0-4602-a913-551609bfb51d tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:35:54.734319 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-4be057b6-b8f0-4602-a913-551609bfb51d tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] [instance: 8b820379-bb78-465a-a84d-7c1e945c74da] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:35:54.741821 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-4be057b6-b8f0-4602-a913-551609bfb51d tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:54.742308 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-4be057b6-b8f0-4602-a913-551609bfb51d tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:54.743135 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-4be057b6-b8f0-4602-a913-551609bfb51d tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:54.743575 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-4be057b6-b8f0-4602-a913-551609bfb51d tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:54.908289 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-4be057b6-b8f0-4602-a913-551609bfb51d tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ad8b76baf294f91bc4c641280ab03f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '120a6c484bec4e52bc5891c927647e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:35:54.916330 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-4be057b6-b8f0-4602-a913-551609bfb51d tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] 10.222.0.65 "GET /compute/v2.1/servers/8b820379-bb78-465a-a84d-7c1e945c74da" status: 200 len: 1318 microversion: 2.1 time: 0.187421 May 19 21:35:54.916988 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 220/452] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:35:54 2022] GET /compute/v2.1/servers/8b820379-bb78-465a-a84d-7c1e945c74da => generated 1318 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:35:55.255101 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-de493f66-6fa4-41d4-8f84-c5aa576f14e3 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:35:55.255875 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-de493f66-6fa4-41d4-8f84-c5aa576f14e3 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] [instance: a331902f-10a9-4bca-bffb-8750e5f1a595] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:35:55.264109 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-de493f66-6fa4-41d4-8f84-c5aa576f14e3 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:55.264573 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-de493f66-6fa4-41d4-8f84-c5aa576f14e3 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:55.265351 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-de493f66-6fa4-41d4-8f84-c5aa576f14e3 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:55.265777 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-de493f66-6fa4-41d4-8f84-c5aa576f14e3 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:55.424094 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-de493f66-6fa4-41d4-8f84-c5aa576f14e3 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4113ddb776d144f0ae2bb2b7d28e775a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c887b19b903a4702b2812ef9b5b88ddc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:35:55.432264 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-de493f66-6fa4-41d4-8f84-c5aa576f14e3 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] 10.222.0.65 "GET /compute/v2.1/servers/a331902f-10a9-4bca-bffb-8750e5f1a595" status: 200 len: 1315 microversion: 2.1 time: 0.181347 May 19 21:35:55.432866 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 233/453] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:35:55 2022] GET /compute/v2.1/servers/a331902f-10a9-4bca-bffb-8750e5f1a595 => generated 1315 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:35:55.819328 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [req-5eb7cbeb-cb7d-40d3-80b5-46a7ed164c59 req-de110d7b-6305-4b77-a404-967181c32147 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a331902f-10a9-4bca-bffb-8750e5f1a595", "name": "network-vif-plugged", "status": "completed", "tag": "59f66ac2-91ff-4c1a-84e9-ba6ea1689ab2"}]} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:35:55.823847 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_cell0:SELECT=2 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:35:55.831555 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-5eb7cbeb-cb7d-40d3-80b5-46a7ed164c59 req-de110d7b-6305-4b77-a404-967181c32147 service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:55.831982 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-5eb7cbeb-cb7d-40d3-80b5-46a7ed164c59 req-de110d7b-6305-4b77-a404-967181c32147 service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:55.858723 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.compute.server_external_events [req-5eb7cbeb-cb7d-40d3-80b5-46a7ed164c59 req-de110d7b-6305-4b77-a404-967181c32147 service nova] Creating event network-vif-plugged:59f66ac2-91ff-4c1a-84e9-ba6ea1689ab2 for instance a331902f-10a9-4bca-bffb-8750e5f1a595 on hv-cinder-83563 May 19 21:35:55.865353 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [req-5eb7cbeb-cb7d-40d3-80b5-46a7ed164c59 req-de110d7b-6305-4b77-a404-967181c32147 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050310 May 19 21:35:55.866482 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 221/454] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 21:35:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 21:35:55.935870 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-395abfd5-6c99-44cf-92c5-fe654005fb33 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:35:55.937069 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-395abfd5-6c99-44cf-92c5-fe654005fb33 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] [instance: 8b820379-bb78-465a-a84d-7c1e945c74da] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:35:55.945680 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-395abfd5-6c99-44cf-92c5-fe654005fb33 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:55.946543 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-395abfd5-6c99-44cf-92c5-fe654005fb33 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:55.948009 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-395abfd5-6c99-44cf-92c5-fe654005fb33 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:55.948785 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-395abfd5-6c99-44cf-92c5-fe654005fb33 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:56.224270 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-395abfd5-6c99-44cf-92c5-fe654005fb33 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ad8b76baf294f91bc4c641280ab03f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '120a6c484bec4e52bc5891c927647e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:35:56.233238 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-395abfd5-6c99-44cf-92c5-fe654005fb33 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] 10.222.0.65 "GET /compute/v2.1/servers/8b820379-bb78-465a-a84d-7c1e945c74da" status: 200 len: 1507 microversion: 2.1 time: 0.303682 May 19 21:35:56.233939 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 234/455] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:35:55 2022] GET /compute/v2.1/servers/8b820379-bb78-465a-a84d-7c1e945c74da => generated 1507 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:35:56.452209 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-18dfdaf5-9d85-4ce5-9c3a-3b2a0f84ac96 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:35:56.452914 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-18dfdaf5-9d85-4ce5-9c3a-3b2a0f84ac96 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] [instance: a331902f-10a9-4bca-bffb-8750e5f1a595] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:35:56.459865 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-18dfdaf5-9d85-4ce5-9c3a-3b2a0f84ac96 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:56.460318 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-18dfdaf5-9d85-4ce5-9c3a-3b2a0f84ac96 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:56.461228 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-18dfdaf5-9d85-4ce5-9c3a-3b2a0f84ac96 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:56.461732 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-18dfdaf5-9d85-4ce5-9c3a-3b2a0f84ac96 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:56.642499 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-18dfdaf5-9d85-4ce5-9c3a-3b2a0f84ac96 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4113ddb776d144f0ae2bb2b7d28e775a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c887b19b903a4702b2812ef9b5b88ddc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:35:56.651629 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-18dfdaf5-9d85-4ce5-9c3a-3b2a0f84ac96 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] 10.222.0.65 "GET /compute/v2.1/servers/a331902f-10a9-4bca-bffb-8750e5f1a595" status: 200 len: 1315 microversion: 2.1 time: 0.203907 May 19 21:35:56.652537 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 222/456] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:35:56 2022] GET /compute/v2.1/servers/a331902f-10a9-4bca-bffb-8750e5f1a595 => generated 1315 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:35:57.672923 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-ef1eb5a9-0551-447a-8e92-e33913d1c66d tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:35:57.673872 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-ef1eb5a9-0551-447a-8e92-e33913d1c66d tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] [instance: a331902f-10a9-4bca-bffb-8750e5f1a595] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:35:57.684598 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ef1eb5a9-0551-447a-8e92-e33913d1c66d tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:57.685426 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ef1eb5a9-0551-447a-8e92-e33913d1c66d tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:57.687027 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ef1eb5a9-0551-447a-8e92-e33913d1c66d tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:57.687881 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ef1eb5a9-0551-447a-8e92-e33913d1c66d tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:57.864561 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-ef1eb5a9-0551-447a-8e92-e33913d1c66d tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4113ddb776d144f0ae2bb2b7d28e775a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c887b19b903a4702b2812ef9b5b88ddc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:35:57.878926 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-ef1eb5a9-0551-447a-8e92-e33913d1c66d tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] 10.222.0.65 "GET /compute/v2.1/servers/a331902f-10a9-4bca-bffb-8750e5f1a595" status: 200 len: 1315 microversion: 2.1 time: 0.209904 May 19 21:35:57.879968 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 235/457] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:35:57 2022] GET /compute/v2.1/servers/a331902f-10a9-4bca-bffb-8750e5f1a595 => generated 1315 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:35:58.903974 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-01f0f2fd-b77a-4323-8e9f-167e36e96f41 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:35:58.904960 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-01f0f2fd-b77a-4323-8e9f-167e36e96f41 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] [instance: a331902f-10a9-4bca-bffb-8750e5f1a595] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:35:58.913027 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-01f0f2fd-b77a-4323-8e9f-167e36e96f41 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:58.913545 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-01f0f2fd-b77a-4323-8e9f-167e36e96f41 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:58.914443 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-01f0f2fd-b77a-4323-8e9f-167e36e96f41 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:35:58.914877 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-01f0f2fd-b77a-4323-8e9f-167e36e96f41 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:35:59.088101 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-01f0f2fd-b77a-4323-8e9f-167e36e96f41 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4113ddb776d144f0ae2bb2b7d28e775a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c887b19b903a4702b2812ef9b5b88ddc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:35:59.097520 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-01f0f2fd-b77a-4323-8e9f-167e36e96f41 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] 10.222.0.65 "GET /compute/v2.1/servers/a331902f-10a9-4bca-bffb-8750e5f1a595" status: 200 len: 1315 microversion: 2.1 time: 0.197882 May 19 21:35:59.098133 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 223/458] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:35:58 2022] GET /compute/v2.1/servers/a331902f-10a9-4bca-bffb-8750e5f1a595 => generated 1315 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:36:00.120613 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-6b3cef52-bbfc-40e1-a0ee-356a024b96a3 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:36:00.121906 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-6b3cef52-bbfc-40e1-a0ee-356a024b96a3 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] [instance: a331902f-10a9-4bca-bffb-8750e5f1a595] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:36:00.128618 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6b3cef52-bbfc-40e1-a0ee-356a024b96a3 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:00.129107 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6b3cef52-bbfc-40e1-a0ee-356a024b96a3 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:00.129920 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6b3cef52-bbfc-40e1-a0ee-356a024b96a3 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:00.130530 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6b3cef52-bbfc-40e1-a0ee-356a024b96a3 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:00.296195 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-6b3cef52-bbfc-40e1-a0ee-356a024b96a3 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4113ddb776d144f0ae2bb2b7d28e775a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c887b19b903a4702b2812ef9b5b88ddc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:00.298608 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell1:SELECT=100 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:36:00.305253 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-6b3cef52-bbfc-40e1-a0ee-356a024b96a3 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] 10.222.0.65 "GET /compute/v2.1/servers/a331902f-10a9-4bca-bffb-8750e5f1a595" status: 200 len: 1315 microversion: 2.1 time: 0.191216 May 19 21:36:00.305852 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 236/459] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:36:00 2022] GET /compute/v2.1/servers/a331902f-10a9-4bca-bffb-8750e5f1a595 => generated 1315 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:36:01.323121 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-b6c53bc5-6e36-4c1a-9e0c-3aa00d7abd0c tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:36:01.324347 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-b6c53bc5-6e36-4c1a-9e0c-3aa00d7abd0c tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] [instance: a331902f-10a9-4bca-bffb-8750e5f1a595] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:36:01.331466 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-b6c53bc5-6e36-4c1a-9e0c-3aa00d7abd0c tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:01.331906 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-b6c53bc5-6e36-4c1a-9e0c-3aa00d7abd0c tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:01.332671 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-b6c53bc5-6e36-4c1a-9e0c-3aa00d7abd0c tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:01.333099 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-b6c53bc5-6e36-4c1a-9e0c-3aa00d7abd0c tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:01.477314 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-b6c53bc5-6e36-4c1a-9e0c-3aa00d7abd0c tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4113ddb776d144f0ae2bb2b7d28e775a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c887b19b903a4702b2812ef9b5b88ddc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:01.486030 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-b6c53bc5-6e36-4c1a-9e0c-3aa00d7abd0c tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] 10.222.0.65 "GET /compute/v2.1/servers/a331902f-10a9-4bca-bffb-8750e5f1a595" status: 200 len: 1465 microversion: 2.1 time: 0.166919 May 19 21:36:01.486638 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 224/460] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:36:01 2022] GET /compute/v2.1/servers/a331902f-10a9-4bca-bffb-8750e5f1a595 => generated 1465 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:36:01.530874 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-a49ee942-d3ed-4423-a3a5-253107aed33d tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:36:01.531449 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-a49ee942-d3ed-4423-a3a5-253107aed33d tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] [instance: a331902f-10a9-4bca-bffb-8750e5f1a595] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:36:01.538436 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a49ee942-d3ed-4423-a3a5-253107aed33d tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:01.538934 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a49ee942-d3ed-4423-a3a5-253107aed33d tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:01.539725 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a49ee942-d3ed-4423-a3a5-253107aed33d tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:01.540194 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a49ee942-d3ed-4423-a3a5-253107aed33d tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:01.569214 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-a49ee942-d3ed-4423-a3a5-253107aed33d tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] [instance: a331902f-10a9-4bca-bffb-8750e5f1a595] Going to try to terminate instance {{(pid=124350) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 21:36:01.663183 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-a49ee942-d3ed-4423-a3a5-253107aed33d tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] 10.222.0.65 "DELETE /compute/v2.1/servers/a331902f-10a9-4bca-bffb-8750e5f1a595" status: 204 len: 0 microversion: 2.1 time: 0.136348 May 19 21:36:01.664568 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 237/461] 10.222.0.65 () {58 vars in 1238 bytes} [Thu May 19 21:36:01 2022] DELETE /compute/v2.1/servers/a331902f-10a9-4bca-bffb-8750e5f1a595 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 21:36:01.675484 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-205693a6-6a54-448f-9871-5974ed998dc9 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:36:01.676104 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-205693a6-6a54-448f-9871-5974ed998dc9 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] [instance: a331902f-10a9-4bca-bffb-8750e5f1a595] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:36:01.682456 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-205693a6-6a54-448f-9871-5974ed998dc9 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:01.682902 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-205693a6-6a54-448f-9871-5974ed998dc9 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:01.684362 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-205693a6-6a54-448f-9871-5974ed998dc9 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:01.684807 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-205693a6-6a54-448f-9871-5974ed998dc9 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:01.854905 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-205693a6-6a54-448f-9871-5974ed998dc9 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4113ddb776d144f0ae2bb2b7d28e775a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c887b19b903a4702b2812ef9b5b88ddc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:01.865557 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-205693a6-6a54-448f-9871-5974ed998dc9 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] 10.222.0.65 "GET /compute/v2.1/servers/a331902f-10a9-4bca-bffb-8750e5f1a595" status: 200 len: 1471 microversion: 2.1 time: 0.194319 May 19 21:36:01.866158 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 225/462] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:36:01 2022] GET /compute/v2.1/servers/a331902f-10a9-4bca-bffb-8750e5f1a595 => generated 1471 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:36:02.884211 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-a618d0c3-8b1a-48e8-adb9-c0296d855df8 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:36:02.884900 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-a618d0c3-8b1a-48e8-adb9-c0296d855df8 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] [instance: a331902f-10a9-4bca-bffb-8750e5f1a595] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:36:02.892417 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a618d0c3-8b1a-48e8-adb9-c0296d855df8 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:02.892858 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a618d0c3-8b1a-48e8-adb9-c0296d855df8 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:02.893628 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a618d0c3-8b1a-48e8-adb9-c0296d855df8 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:02.894051 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a618d0c3-8b1a-48e8-adb9-c0296d855df8 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:03.035330 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-a618d0c3-8b1a-48e8-adb9-c0296d855df8 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4113ddb776d144f0ae2bb2b7d28e775a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c887b19b903a4702b2812ef9b5b88ddc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:03.043253 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-a618d0c3-8b1a-48e8-adb9-c0296d855df8 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] 10.222.0.65 "GET /compute/v2.1/servers/a331902f-10a9-4bca-bffb-8750e5f1a595" status: 200 len: 1471 microversion: 2.1 time: 0.163324 May 19 21:36:03.043823 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 238/463] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:36:02 2022] GET /compute/v2.1/servers/a331902f-10a9-4bca-bffb-8750e5f1a595 => generated 1471 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:36:03.415778 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-bc3010ab-a4b6-4747-9202-ad99e923d792 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:36:03.416427 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-bc3010ab-a4b6-4747-9202-ad99e923d792 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: e0250d7d-3766-4555-a9af-2429afad53bf] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:36:03.423658 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-bc3010ab-a4b6-4747-9202-ad99e923d792 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:03.424096 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-bc3010ab-a4b6-4747-9202-ad99e923d792 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:03.424895 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-bc3010ab-a4b6-4747-9202-ad99e923d792 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:03.425316 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-bc3010ab-a4b6-4747-9202-ad99e923d792 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:03.453290 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-bc3010ab-a4b6-4747-9202-ad99e923d792 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf/ips" status: 200 len: 153 microversion: 2.20 time: 0.041363 May 19 21:36:03.454046 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 226/464] 10.222.0.65 () {60 vars in 1288 bytes} [Thu May 19 21:36:03 2022] GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf/ips => generated 153 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 21:36:04.061784 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-49425bc5-e56b-48bf-9164-82e95c97f10b tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:36:04.062508 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-49425bc5-e56b-48bf-9164-82e95c97f10b tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] [instance: a331902f-10a9-4bca-bffb-8750e5f1a595] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:36:04.070538 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-49425bc5-e56b-48bf-9164-82e95c97f10b tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:04.070982 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-49425bc5-e56b-48bf-9164-82e95c97f10b tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:04.071781 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-49425bc5-e56b-48bf-9164-82e95c97f10b tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:04.072201 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-49425bc5-e56b-48bf-9164-82e95c97f10b tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:04.212281 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-49425bc5-e56b-48bf-9164-82e95c97f10b tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4113ddb776d144f0ae2bb2b7d28e775a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c887b19b903a4702b2812ef9b5b88ddc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:04.220814 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-49425bc5-e56b-48bf-9164-82e95c97f10b tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] 10.222.0.65 "GET /compute/v2.1/servers/a331902f-10a9-4bca-bffb-8750e5f1a595" status: 200 len: 1471 microversion: 2.1 time: 0.163554 May 19 21:36:04.221666 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 239/465] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:36:04 2022] GET /compute/v2.1/servers/a331902f-10a9-4bca-bffb-8750e5f1a595 => generated 1471 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:36:04.687733 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-dc0a5f47-57dd-4d24-88f1-2071fccea86f tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:36:04.688360 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-dc0a5f47-57dd-4d24-88f1-2071fccea86f tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] [instance: 89cb2230-d75e-4c8c-b47b-83f1698654dd] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:36:04.695606 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-dc0a5f47-57dd-4d24-88f1-2071fccea86f tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:04.696046 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-dc0a5f47-57dd-4d24-88f1-2071fccea86f tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:04.696831 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-dc0a5f47-57dd-4d24-88f1-2071fccea86f tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:04.697274 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-dc0a5f47-57dd-4d24-88f1-2071fccea86f tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:04.867705 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-dc0a5f47-57dd-4d24-88f1-2071fccea86f tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1664dba0cd9b4d9da1e4b78691b8567e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fcf03712c6f4926a2a95dfd0519536a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:04.884329 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-dc0a5f47-57dd-4d24-88f1-2071fccea86f tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] 10.222.0.65 "GET /compute/v2.1/servers/89cb2230-d75e-4c8c-b47b-83f1698654dd" status: 200 len: 1594 microversion: 2.1 time: 0.199939 May 19 21:36:04.885780 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 227/466] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:36:04 2022] GET /compute/v2.1/servers/89cb2230-d75e-4c8c-b47b-83f1698654dd => generated 1594 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:36:05.246325 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-6a381af0-a5a0-4b7c-aaa1-a2c66255fe82 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:36:05.247683 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-6a381af0-a5a0-4b7c-aaa1-a2c66255fe82 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] [instance: a331902f-10a9-4bca-bffb-8750e5f1a595] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:36:05.273295 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [req-bed324f3-18c5-47f3-90f1-e7cdf2a06167 req-baba7157-87ae-47d8-a7bf-47a67e9a4725 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a331902f-10a9-4bca-bffb-8750e5f1a595", "name": "network-vif-deleted", "tag": "59f66ac2-91ff-4c1a-84e9-ba6ea1689ab2"}]} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:36:05.279580 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6a381af0-a5a0-4b7c-aaa1-a2c66255fe82 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:05.280365 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6a381af0-a5a0-4b7c-aaa1-a2c66255fe82 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:05.281021 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6a381af0-a5a0-4b7c-aaa1-a2c66255fe82 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:05.281461 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6a381af0-a5a0-4b7c-aaa1-a2c66255fe82 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:05.331801 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-bed324f3-18c5-47f3-90f1-e7cdf2a06167 req-baba7157-87ae-47d8-a7bf-47a67e9a4725 service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:05.335863 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-bed324f3-18c5-47f3-90f1-e7cdf2a06167 req-baba7157-87ae-47d8-a7bf-47a67e9a4725 service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:05.367809 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.compute.server_external_events [req-bed324f3-18c5-47f3-90f1-e7cdf2a06167 req-baba7157-87ae-47d8-a7bf-47a67e9a4725 service nova] Creating event network-vif-deleted:59f66ac2-91ff-4c1a-84e9-ba6ea1689ab2 for instance a331902f-10a9-4bca-bffb-8750e5f1a595 on hv-cinder-83563 May 19 21:36:05.386265 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-6a381af0-a5a0-4b7c-aaa1-a2c66255fe82 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4113ddb776d144f0ae2bb2b7d28e775a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c887b19b903a4702b2812ef9b5b88ddc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:05.388994 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [req-bed324f3-18c5-47f3-90f1-e7cdf2a06167 req-baba7157-87ae-47d8-a7bf-47a67e9a4725 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124281 May 19 21:36:05.395443 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 228/467] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 21:36:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 21:36:05.398412 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-6a381af0-a5a0-4b7c-aaa1-a2c66255fe82 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] 10.222.0.65 "GET /compute/v2.1/servers/a331902f-10a9-4bca-bffb-8750e5f1a595" status: 200 len: 1429 microversion: 2.1 time: 0.163162 May 19 21:36:05.411122 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 240/468] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:36:05 2022] GET /compute/v2.1/servers/a331902f-10a9-4bca-bffb-8750e5f1a595 => generated 1429 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:36:06.423499 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-9f47bab6-41eb-4763-9e08-23c3c5f11105 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:36:06.425329 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-9f47bab6-41eb-4763-9e08-23c3c5f11105 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] [instance: a331902f-10a9-4bca-bffb-8750e5f1a595] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:36:06.436451 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-9f47bab6-41eb-4763-9e08-23c3c5f11105 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:06.437228 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-9f47bab6-41eb-4763-9e08-23c3c5f11105 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:06.439267 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-9f47bab6-41eb-4763-9e08-23c3c5f11105 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:06.440367 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-9f47bab6-41eb-4763-9e08-23c3c5f11105 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:06.468399 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.wsgi [None req-9f47bab6-41eb-4763-9e08-23c3c5f11105 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] HTTP exception thrown: Instance a331902f-10a9-4bca-bffb-8750e5f1a595 could not be found. May 19 21:36:06.472173 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-9f47bab6-41eb-4763-9e08-23c3c5f11105 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Request method failure captured: May 19 21:36:06.472173 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: request: GET /compute/v2.1/servers/a331902f-10a9-4bca-bffb-8750e5f1a595 HTTP/1.1 May 19 21:36:06.472173 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Accept: application/json May 19 21:36:06.472173 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Accept-Encoding: identity May 19 21:36:06.472173 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Connection: close May 19 21:36:06.472173 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Content-Length: 0 May 19 21:36:06.472173 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Content-Type: application/json May 19 21:36:06.472173 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Host: 10.222.0.65 May 19 21:36:06.472173 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Openstack-System-Scope: None May 19 21:36:06.472173 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: User-Agent: python-urllib3/1.26.9 May 19 21:36:06.472173 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Auth-Token: gAAAAABihrgfxGKbnJsKrEj9Jcyz4VIQoWVIZNpF4n83y3YxegTX8gSw5wALlcKt71HyK-TrKp1X55y8OTWpx7FawaeNj4fXcIK05OlMKRCpEDfRNA0qu8NU0MzfJ5Q-RIJvvEs94YsJL21hNwEW8bLwCk1392JGa5b-c44dZ3h19PrhQZCA3SU May 19 21:36:06.472173 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Domain-Id: None May 19 21:36:06.472173 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Domain-Name: None May 19 21:36:06.472173 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Identity-Status: Confirmed May 19 21:36:06.472173 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Is-Admin-Project: True May 19 21:36:06.472173 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Project-Domain-Id: default May 19 21:36:06.472173 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Project-Domain-Name: Default May 19 21:36:06.472173 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Project-Id: c887b19b903a4702b2812ef9b5b88ddc May 19 21:36:06.472173 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Project-Name: tempest-VolumesNegativeTest-250895330 May 19 21:36:06.472173 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Role: reader,member May 19 21:36:06.472173 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Roles: reader,member May 19 21:36:06.475224 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/c887b19b903a4702b2812ef9b5b88ddc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/c887b19b903a4702b2812ef9b5b88ddc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_c887b19b903a4702b2812ef9b5b88ddc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/c887b19b903a4702b2812ef9b5b88ddc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}] May 19 21:36:06.475224 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Tenant: tempest-VolumesNegativeTest-250895330 May 19 21:36:06.475224 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Tenant-Id: c887b19b903a4702b2812ef9b5b88ddc May 19 21:36:06.475224 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Tenant-Name: tempest-VolumesNegativeTest-250895330 May 19 21:36:06.475224 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-User: tempest-VolumesNegativeTest-250895330-project May 19 21:36:06.475224 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-User-Domain-Id: default May 19 21:36:06.475224 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-User-Domain-Name: Default May 19 21:36:06.475224 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-User-Id: 4113ddb776d144f0ae2bb2b7d28e775a May 19 21:36:06.475224 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-User-Name: tempest-VolumesNegativeTest-250895330-project May 19 21:36:06.475224 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: method: > May 19 21:36:06.475224 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: exception: Instance a331902f-10a9-4bca-bffb-8750e5f1a595 could not be found. May 19 21:36:06.475224 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: action_args: {'id': 'a331902f-10a9-4bca-bffb-8750e5f1a595'} May 19 21:36:06.477017 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 21:36:06.477017 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:36:06.477017 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 21:36:06.477017 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 21:36:06.477017 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 21:36:06.477017 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 21:36:06.477017 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 21:36:06.477017 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 21:36:06.477017 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 21:36:06.477017 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 21:36:06.477017 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a331902f-10a9-4bca-bffb-8750e5f1a595 could not be found. May 19 21:36:06.477017 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:36:06.477017 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 21:36:06.477017 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:36:06.477017 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:36:06.477017 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 21:36:06.477017 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 21:36:06.477017 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 21:36:06.477017 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 21:36:06.477017 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 21:36:06.479308 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 21:36:06.479308 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 21:36:06.479308 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 21:36:06.479308 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 21:36:06.479308 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 21:36:06.479308 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 21:36:06.479308 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 21:36:06.479308 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a331902f-10a9-4bca-bffb-8750e5f1a595 could not be found. May 19 21:36:06.479308 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:36:06.479308 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 21:36:06.479308 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:36:06.479308 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:36:06.479308 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 21:36:06.479308 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 21:36:06.479308 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 21:36:06.479308 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 21:36:06.479308 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a331902f-10a9-4bca-bffb-8750e5f1a595 could not be found. May 19 21:36:06.479308 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:36:06.481401 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-9f47bab6-41eb-4763-9e08-23c3c5f11105 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] Returning 404 to user: Instance a331902f-10a9-4bca-bffb-8750e5f1a595 could not be found. {{(pid=124349) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 21:36:06.481401 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-9f47bab6-41eb-4763-9e08-23c3c5f11105 tempest-VolumesNegativeTest-250895330 tempest-VolumesNegativeTest-250895330-project] 10.222.0.65 "GET /compute/v2.1/servers/a331902f-10a9-4bca-bffb-8750e5f1a595" status: 404 len: 111 microversion: 2.1 time: 0.060394 May 19 21:36:06.481401 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 229/469] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:36:06 2022] GET /compute/v2.1/servers/a331902f-10a9-4bca-bffb-8750e5f1a595 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 21:36:06.673555 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-a5e8f305-ad83-4412-8b65-6af6b643b2b0 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:36:06.674886 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-a5e8f305-ad83-4412-8b65-6af6b643b2b0 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: e0250d7d-3766-4555-a9af-2429afad53bf] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:36:06.688295 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a5e8f305-ad83-4412-8b65-6af6b643b2b0 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:06.689096 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a5e8f305-ad83-4412-8b65-6af6b643b2b0 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:06.690533 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a5e8f305-ad83-4412-8b65-6af6b643b2b0 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:06.691066 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a5e8f305-ad83-4412-8b65-6af6b643b2b0 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:06.754097 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.objects.instance [None req-a5e8f305-ad83-4412-8b65-6af6b643b2b0 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lazy-loading 'flavor' on Instance uuid e0250d7d-3766-4555-a9af-2429afad53bf {{(pid=124350) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 21:36:07.279827 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [req-2daa6dc1-b556-4e79-a73a-75436c07f63f req-4622e71d-0c7b-4002-ab48-d6bc916ff5e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89cb2230-d75e-4c8c-b47b-83f1698654dd", "tag": "c48b591a-ce03-49e5-b5c1-3715c76df0d6"}]} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:36:07.288602 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-2daa6dc1-b556-4e79-a73a-75436c07f63f req-4622e71d-0c7b-4002-ab48-d6bc916ff5e1 service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:07.289038 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-2daa6dc1-b556-4e79-a73a-75436c07f63f req-4622e71d-0c7b-4002-ab48-d6bc916ff5e1 service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:07.304237 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.compute.server_external_events [req-2daa6dc1-b556-4e79-a73a-75436c07f63f req-4622e71d-0c7b-4002-ab48-d6bc916ff5e1 service nova] Creating event network-changed:c48b591a-ce03-49e5-b5c1-3715c76df0d6 for instance 89cb2230-d75e-4c8c-b47b-83f1698654dd on hv-cinder-83563 May 19 21:36:07.311435 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [req-2daa6dc1-b556-4e79-a73a-75436c07f63f req-4622e71d-0c7b-4002-ab48-d6bc916ff5e1 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035878 May 19 21:36:07.316476 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 230/470] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 21:36:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 21:36:07.400909 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-a5e8f305-ad83-4412-8b65-6af6b643b2b0 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "POST /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf/action" status: 202 len: 0 microversion: 2.20 time: 0.733730 May 19 21:36:07.422530 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-096b0bc3-27f6-4f28-8f8b-7c2988605b40 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:36:07.423239 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-096b0bc3-27f6-4f28-8f8b-7c2988605b40 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: e0250d7d-3766-4555-a9af-2429afad53bf] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:36:07.429631 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 241/471] 10.222.0.65 () {62 vars in 1318 bytes} [Thu May 19 21:36:06 2022] POST /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf/action => generated 0 bytes in 763 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 19 21:36:07.438769 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-096b0bc3-27f6-4f28-8f8b-7c2988605b40 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:07.440161 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-096b0bc3-27f6-4f28-8f8b-7c2988605b40 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:07.441252 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-096b0bc3-27f6-4f28-8f8b-7c2988605b40 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:07.442373 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-096b0bc3-27f6-4f28-8f8b-7c2988605b40 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:07.768497 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-096b0bc3-27f6-4f28-8f8b-7c2988605b40 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:07.796528 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-096b0bc3-27f6-4f28-8f8b-7c2988605b40 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:07.798077 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-096b0bc3-27f6-4f28-8f8b-7c2988605b40 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:07.806816 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-096b0bc3-27f6-4f28-8f8b-7c2988605b40 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf" status: 200 len: 1724 microversion: 2.20 time: 0.399532 May 19 21:36:07.807948 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 231/472] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:36:07 2022] GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf => generated 1724 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:36:08.830897 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-e2065c11-652c-4ade-ba6e-4bb5de1c2fc1 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:36:08.833846 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-e2065c11-652c-4ade-ba6e-4bb5de1c2fc1 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: e0250d7d-3766-4555-a9af-2429afad53bf] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:36:08.860193 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e2065c11-652c-4ade-ba6e-4bb5de1c2fc1 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:08.860641 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e2065c11-652c-4ade-ba6e-4bb5de1c2fc1 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:08.861441 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e2065c11-652c-4ade-ba6e-4bb5de1c2fc1 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:08.861879 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e2065c11-652c-4ade-ba6e-4bb5de1c2fc1 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:09.003678 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-fb3278f6-ead8-4453-a812-9230d462b7d5 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-569033552"}} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:36:09.004612 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-fb3278f6-ead8-4453-a812-9230d462b7d5 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] [instance: 89cb2230-d75e-4c8c-b47b-83f1698654dd] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:36:09.020618 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-fb3278f6-ead8-4453-a812-9230d462b7d5 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:09.021341 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-fb3278f6-ead8-4453-a812-9230d462b7d5 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:09.022410 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-fb3278f6-ead8-4453-a812-9230d462b7d5 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:09.023013 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-fb3278f6-ead8-4453-a812-9230d462b7d5 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:09.093294 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-e2065c11-652c-4ade-ba6e-4bb5de1c2fc1 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:09.103925 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-e2065c11-652c-4ade-ba6e-4bb5de1c2fc1 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:09.105791 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-e2065c11-652c-4ade-ba6e-4bb5de1c2fc1 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:09.107341 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-e2065c11-652c-4ade-ba6e-4bb5de1c2fc1 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf" status: 200 len: 1724 microversion: 2.20 time: 0.281651 May 19 21:36:09.108408 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 242/473] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:36:08 2022] GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf => generated 1724 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:36:09.222827 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.network.security_group_api [None req-fb3278f6-ead8-4453-a812-9230d462b7d5 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Adding security group 082c9cd4-963c-4820-b7ef-bef409d33ad2 to port c48b591a-ce03-49e5-b5c1-3715c76df0d6 May 19 21:36:09.777827 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-fb3278f6-ead8-4453-a812-9230d462b7d5 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] 10.222.0.65 "POST /compute/v2.1/servers/89cb2230-d75e-4c8c-b47b-83f1698654dd/action" status: 202 len: 0 microversion: 2.1 time: 0.775017 May 19 21:36:09.777827 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 232/474] 10.222.0.65 () {60 vars in 1277 bytes} [Thu May 19 21:36:08 2022] POST /compute/v2.1/servers/89cb2230-d75e-4c8c-b47b-83f1698654dd/action => generated 0 bytes in 778 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 19 21:36:09.791711 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [req-d86b8fa3-d6f5-41a2-a0c9-abd9cf411a33 req-d353a150-fe6b-45a5-b8f4-ae33888ff112 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89cb2230-d75e-4c8c-b47b-83f1698654dd", "tag": "c48b591a-ce03-49e5-b5c1-3715c76df0d6"}]} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:36:09.794965 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-80114f1b-dc34-4ba0-9df0-97fa538978a5 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:36:09.809110 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-d86b8fa3-d6f5-41a2-a0c9-abd9cf411a33 req-d353a150-fe6b-45a5-b8f4-ae33888ff112 service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:09.809770 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-d86b8fa3-d6f5-41a2-a0c9-abd9cf411a33 req-d353a150-fe6b-45a5-b8f4-ae33888ff112 service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:09.813638 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-80114f1b-dc34-4ba0-9df0-97fa538978a5 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] [instance: 89cb2230-d75e-4c8c-b47b-83f1698654dd] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:36:09.827398 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.compute.server_external_events [req-d86b8fa3-d6f5-41a2-a0c9-abd9cf411a33 req-d353a150-fe6b-45a5-b8f4-ae33888ff112 service nova] Creating event network-changed:c48b591a-ce03-49e5-b5c1-3715c76df0d6 for instance 89cb2230-d75e-4c8c-b47b-83f1698654dd on hv-cinder-83563 May 19 21:36:09.841355 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [req-d86b8fa3-d6f5-41a2-a0c9-abd9cf411a33 req-d353a150-fe6b-45a5-b8f4-ae33888ff112 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056635 May 19 21:36:09.841968 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 233/475] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 21:36:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 21:36:09.843868 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-80114f1b-dc34-4ba0-9df0-97fa538978a5 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:09.844843 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-80114f1b-dc34-4ba0-9df0-97fa538978a5 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:09.847227 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-80114f1b-dc34-4ba0-9df0-97fa538978a5 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:09.848152 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-80114f1b-dc34-4ba0-9df0-97fa538978a5 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:10.132315 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-3de6f216-771e-4ea2-adc0-c961c983955e tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:36:10.133088 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-3de6f216-771e-4ea2-adc0-c961c983955e tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: e0250d7d-3766-4555-a9af-2429afad53bf] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:36:10.148988 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-3de6f216-771e-4ea2-adc0-c961c983955e tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:10.149190 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-3de6f216-771e-4ea2-adc0-c961c983955e tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:10.150394 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-3de6f216-771e-4ea2-adc0-c961c983955e tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:10.151096 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-3de6f216-771e-4ea2-adc0-c961c983955e tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:10.208933 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-80114f1b-dc34-4ba0-9df0-97fa538978a5 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1664dba0cd9b4d9da1e4b78691b8567e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fcf03712c6f4926a2a95dfd0519536a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:10.224689 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-80114f1b-dc34-4ba0-9df0-97fa538978a5 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] 10.222.0.65 "GET /compute/v2.1/servers/89cb2230-d75e-4c8c-b47b-83f1698654dd" status: 200 len: 1759 microversion: 2.1 time: 0.442792 May 19 21:36:10.242360 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 243/476] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:36:09 2022] GET /compute/v2.1/servers/89cb2230-d75e-4c8c-b47b-83f1698654dd => generated 1759 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:36:10.468584 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-3de6f216-771e-4ea2-adc0-c961c983955e tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:10.485369 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-3de6f216-771e-4ea2-adc0-c961c983955e tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:10.489220 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-3de6f216-771e-4ea2-adc0-c961c983955e tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:10.491871 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-3de6f216-771e-4ea2-adc0-c961c983955e tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf" status: 200 len: 1724 microversion: 2.20 time: 0.364208 May 19 21:36:10.493238 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 234/477] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:36:10 2022] GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf => generated 1724 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 21:36:11.516670 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-0c450c92-aa30-4ef1-b3c6-fb5e317a8816 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:36:11.517657 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-0c450c92-aa30-4ef1-b3c6-fb5e317a8816 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: e0250d7d-3766-4555-a9af-2429afad53bf] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:36:11.521238 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=1 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:36:11.527580 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0c450c92-aa30-4ef1-b3c6-fb5e317a8816 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:11.528023 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0c450c92-aa30-4ef1-b3c6-fb5e317a8816 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:11.528805 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0c450c92-aa30-4ef1-b3c6-fb5e317a8816 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:11.529266 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0c450c92-aa30-4ef1-b3c6-fb5e317a8816 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:11.682221 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-0c450c92-aa30-4ef1-b3c6-fb5e317a8816 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:11.690816 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-0c450c92-aa30-4ef1-b3c6-fb5e317a8816 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:11.692315 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-0c450c92-aa30-4ef1-b3c6-fb5e317a8816 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:11.693488 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-0c450c92-aa30-4ef1-b3c6-fb5e317a8816 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf" status: 200 len: 1724 microversion: 2.20 time: 0.184514 May 19 21:36:11.694052 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 244/478] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:36:11 2022] GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf => generated 1724 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:36:12.445249 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-aca3441c-a5c7-44de-8b73-21b54119d73b tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:36:12.445853 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-aca3441c-a5c7-44de-8b73-21b54119d73b tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] [instance: a392a14d-152c-467f-8031-a4bb8e36e5bb] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:36:12.453094 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-aca3441c-a5c7-44de-8b73-21b54119d73b tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:12.453634 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-aca3441c-a5c7-44de-8b73-21b54119d73b tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:12.454524 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-aca3441c-a5c7-44de-8b73-21b54119d73b tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:12.455055 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-aca3441c-a5c7-44de-8b73-21b54119d73b tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:12.483397 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-aca3441c-a5c7-44de-8b73-21b54119d73b tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] 10.222.0.65 "GET /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb/ips" status: 200 len: 146 microversion: 2.1 time: 0.042036 May 19 21:36:12.484281 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 235/479] 10.222.0.65 () {58 vars in 1247 bytes} [Thu May 19 21:36:12 2022] GET /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb/ips => generated 146 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 21:36:12.712486 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-6caecab2-8628-4dde-b50f-88836a423599 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:36:12.713691 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-6caecab2-8628-4dde-b50f-88836a423599 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: e0250d7d-3766-4555-a9af-2429afad53bf] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:36:12.721199 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6caecab2-8628-4dde-b50f-88836a423599 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:12.721760 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6caecab2-8628-4dde-b50f-88836a423599 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:12.722650 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6caecab2-8628-4dde-b50f-88836a423599 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:12.723244 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6caecab2-8628-4dde-b50f-88836a423599 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:13.146469 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-6caecab2-8628-4dde-b50f-88836a423599 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:13.157177 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-6caecab2-8628-4dde-b50f-88836a423599 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:13.158686 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-6caecab2-8628-4dde-b50f-88836a423599 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:13.159840 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-6caecab2-8628-4dde-b50f-88836a423599 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf" status: 200 len: 1724 microversion: 2.20 time: 0.451771 May 19 21:36:13.160500 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 245/480] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:36:12 2022] GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf => generated 1724 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:36:14.180069 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-5b361885-18a7-4b92-98be-40d7e3cf908f tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:36:14.180699 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-5b361885-18a7-4b92-98be-40d7e3cf908f tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: e0250d7d-3766-4555-a9af-2429afad53bf] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:36:14.183571 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_api:SELECT=52 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:36:14.189661 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-5b361885-18a7-4b92-98be-40d7e3cf908f tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:14.189970 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-5b361885-18a7-4b92-98be-40d7e3cf908f tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:14.190799 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-5b361885-18a7-4b92-98be-40d7e3cf908f tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:14.191251 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-5b361885-18a7-4b92-98be-40d7e3cf908f tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:14.208323 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:36:14.349812 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-5b361885-18a7-4b92-98be-40d7e3cf908f tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:14.359813 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-5b361885-18a7-4b92-98be-40d7e3cf908f tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:14.361320 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-5b361885-18a7-4b92-98be-40d7e3cf908f tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:14.362691 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-5b361885-18a7-4b92-98be-40d7e3cf908f tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf" status: 200 len: 1724 microversion: 2.20 time: 0.186893 May 19 21:36:14.363252 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 236/481] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:36:14 2022] GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf => generated 1724 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:36:15.382224 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-7f4b535b-7586-4cee-b71b-31fca75a63b7 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:36:15.382964 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-7f4b535b-7586-4cee-b71b-31fca75a63b7 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: e0250d7d-3766-4555-a9af-2429afad53bf] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:36:15.390111 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7f4b535b-7586-4cee-b71b-31fca75a63b7 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:15.390594 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7f4b535b-7586-4cee-b71b-31fca75a63b7 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:15.391382 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7f4b535b-7586-4cee-b71b-31fca75a63b7 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:15.391800 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7f4b535b-7586-4cee-b71b-31fca75a63b7 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:15.537182 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-7f4b535b-7586-4cee-b71b-31fca75a63b7 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:15.545796 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-7f4b535b-7586-4cee-b71b-31fca75a63b7 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:15.547338 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-7f4b535b-7586-4cee-b71b-31fca75a63b7 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:15.548513 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-7f4b535b-7586-4cee-b71b-31fca75a63b7 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf" status: 200 len: 1724 microversion: 2.20 time: 0.170229 May 19 21:36:15.549078 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 246/482] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:36:15 2022] GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:36:16.142990 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-fa51827a-4e61-4387-ab64-cac9891669af tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "26015889-7462-49e9-a316-f339ab1faac2"}} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:36:16.144097 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-fa51827a-4e61-4387-ab64-cac9891669af tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] [instance: a392a14d-152c-467f-8031-a4bb8e36e5bb] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:36:16.151140 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-fa51827a-4e61-4387-ab64-cac9891669af tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:16.151677 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-fa51827a-4e61-4387-ab64-cac9891669af tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:16.152621 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-fa51827a-4e61-4387-ab64-cac9891669af tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:16.153063 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-fa51827a-4e61-4387-ab64-cac9891669af tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:16.437528 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-fa51827a-4e61-4387-ab64-cac9891669af tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] 10.222.0.65 "POST /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.298343 May 19 21:36:16.438130 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 237/483] 10.222.0.65 () {60 vars in 1322 bytes} [Thu May 19 21:36:16 2022] POST /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb/os-volume_attachments => generated 194 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 21:36:16.568275 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-bd5e8455-97b0-45a2-9730-527e3bf8a77a tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:36:16.568932 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-bd5e8455-97b0-45a2-9730-527e3bf8a77a tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: e0250d7d-3766-4555-a9af-2429afad53bf] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:36:16.576652 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-bd5e8455-97b0-45a2-9730-527e3bf8a77a tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:16.577068 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-bd5e8455-97b0-45a2-9730-527e3bf8a77a tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:16.577836 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-bd5e8455-97b0-45a2-9730-527e3bf8a77a tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:16.578256 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-bd5e8455-97b0-45a2-9730-527e3bf8a77a tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:16.732669 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-bd5e8455-97b0-45a2-9730-527e3bf8a77a tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:16.742059 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-bd5e8455-97b0-45a2-9730-527e3bf8a77a tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:16.743939 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-bd5e8455-97b0-45a2-9730-527e3bf8a77a tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:16.745364 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-bd5e8455-97b0-45a2-9730-527e3bf8a77a tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf" status: 200 len: 1724 microversion: 2.20 time: 0.180993 May 19 21:36:16.746048 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 247/484] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:36:16 2022] GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf => generated 1724 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:36:17.766200 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-d326f4d9-9508-424a-bb9d-59c0f126a79d tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:36:17.766879 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-d326f4d9-9508-424a-bb9d-59c0f126a79d tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: e0250d7d-3766-4555-a9af-2429afad53bf] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:36:17.773735 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-d326f4d9-9508-424a-bb9d-59c0f126a79d tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:17.774206 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-d326f4d9-9508-424a-bb9d-59c0f126a79d tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:17.775004 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-d326f4d9-9508-424a-bb9d-59c0f126a79d tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:17.775432 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-d326f4d9-9508-424a-bb9d-59c0f126a79d tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:17.927463 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-d326f4d9-9508-424a-bb9d-59c0f126a79d tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:17.936092 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-d326f4d9-9508-424a-bb9d-59c0f126a79d tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:17.937597 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-d326f4d9-9508-424a-bb9d-59c0f126a79d tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:17.938804 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-d326f4d9-9508-424a-bb9d-59c0f126a79d tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf" status: 200 len: 1724 microversion: 2.20 time: 0.178189 May 19 21:36:17.939364 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 238/485] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:36:17 2022] GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf => generated 1724 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:36:18.961507 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-1011d9b8-19bf-4ccc-9ff8-f3f9a9f0e617 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:36:18.962556 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-1011d9b8-19bf-4ccc-9ff8-f3f9a9f0e617 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: e0250d7d-3766-4555-a9af-2429afad53bf] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:36:18.974484 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1011d9b8-19bf-4ccc-9ff8-f3f9a9f0e617 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:18.975280 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1011d9b8-19bf-4ccc-9ff8-f3f9a9f0e617 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:18.976672 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1011d9b8-19bf-4ccc-9ff8-f3f9a9f0e617 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:18.977445 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1011d9b8-19bf-4ccc-9ff8-f3f9a9f0e617 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:19.128326 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-1011d9b8-19bf-4ccc-9ff8-f3f9a9f0e617 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:19.137179 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-1011d9b8-19bf-4ccc-9ff8-f3f9a9f0e617 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:19.138711 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-1011d9b8-19bf-4ccc-9ff8-f3f9a9f0e617 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:19.139910 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-1011d9b8-19bf-4ccc-9ff8-f3f9a9f0e617 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf" status: 200 len: 1724 microversion: 2.20 time: 0.185886 May 19 21:36:19.140481 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 248/486] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:36:18 2022] GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf => generated 1724 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:36:20.159145 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-34df6fff-d793-49f2-ad37-24e3977b86c8 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:36:20.159891 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-34df6fff-d793-49f2-ad37-24e3977b86c8 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: e0250d7d-3766-4555-a9af-2429afad53bf] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:36:20.167810 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-34df6fff-d793-49f2-ad37-24e3977b86c8 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:20.168266 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-34df6fff-d793-49f2-ad37-24e3977b86c8 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:20.169322 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-34df6fff-d793-49f2-ad37-24e3977b86c8 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:20.169753 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-34df6fff-d793-49f2-ad37-24e3977b86c8 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:20.325779 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-34df6fff-d793-49f2-ad37-24e3977b86c8 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:20.334691 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-34df6fff-d793-49f2-ad37-24e3977b86c8 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:20.336361 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-34df6fff-d793-49f2-ad37-24e3977b86c8 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:20.337579 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-34df6fff-d793-49f2-ad37-24e3977b86c8 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf" status: 200 len: 1724 microversion: 2.20 time: 0.182488 May 19 21:36:20.338956 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 239/487] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:36:20 2022] GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf => generated 1724 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:36:21.360789 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-99cc263f-d225-4233-9dd8-2d9ba55b499d tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:36:21.361675 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-99cc263f-d225-4233-9dd8-2d9ba55b499d tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: e0250d7d-3766-4555-a9af-2429afad53bf] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:36:21.369313 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-99cc263f-d225-4233-9dd8-2d9ba55b499d tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:21.369769 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-99cc263f-d225-4233-9dd8-2d9ba55b499d tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:21.370747 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-99cc263f-d225-4233-9dd8-2d9ba55b499d tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:21.371367 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-99cc263f-d225-4233-9dd8-2d9ba55b499d tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:21.560761 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-99cc263f-d225-4233-9dd8-2d9ba55b499d tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:21.563204 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:36:21.571680 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-99cc263f-d225-4233-9dd8-2d9ba55b499d tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:21.573960 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-99cc263f-d225-4233-9dd8-2d9ba55b499d tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:21.575186 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-99cc263f-d225-4233-9dd8-2d9ba55b499d tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf" status: 200 len: 1724 microversion: 2.20 time: 0.219940 May 19 21:36:21.575752 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 249/488] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:36:21 2022] GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf => generated 1724 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:36:22.595337 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-359f6eb5-3225-4e77-9b6c-d29b003d5c66 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:36:22.595942 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-359f6eb5-3225-4e77-9b6c-d29b003d5c66 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: e0250d7d-3766-4555-a9af-2429afad53bf] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:36:22.604698 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-359f6eb5-3225-4e77-9b6c-d29b003d5c66 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:22.605134 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-359f6eb5-3225-4e77-9b6c-d29b003d5c66 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:22.605924 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-359f6eb5-3225-4e77-9b6c-d29b003d5c66 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:22.606373 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-359f6eb5-3225-4e77-9b6c-d29b003d5c66 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:22.765008 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-359f6eb5-3225-4e77-9b6c-d29b003d5c66 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:22.773765 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-359f6eb5-3225-4e77-9b6c-d29b003d5c66 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:22.775290 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-359f6eb5-3225-4e77-9b6c-d29b003d5c66 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:22.776484 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-359f6eb5-3225-4e77-9b6c-d29b003d5c66 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf" status: 200 len: 1724 microversion: 2.20 time: 0.185289 May 19 21:36:22.777014 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 240/489] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:36:22 2022] GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf => generated 1724 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:36:23.796703 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-d8c34324-e77f-41b1-9a0f-5edb2c0ffedf tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:36:23.797283 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-d8c34324-e77f-41b1-9a0f-5edb2c0ffedf tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: e0250d7d-3766-4555-a9af-2429afad53bf] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:36:23.805108 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d8c34324-e77f-41b1-9a0f-5edb2c0ffedf tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:23.805546 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d8c34324-e77f-41b1-9a0f-5edb2c0ffedf tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:23.806396 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d8c34324-e77f-41b1-9a0f-5edb2c0ffedf tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:23.806826 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d8c34324-e77f-41b1-9a0f-5edb2c0ffedf tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:23.972178 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-d8c34324-e77f-41b1-9a0f-5edb2c0ffedf tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:23.981079 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-d8c34324-e77f-41b1-9a0f-5edb2c0ffedf tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:23.983014 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-d8c34324-e77f-41b1-9a0f-5edb2c0ffedf tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:23.984315 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-d8c34324-e77f-41b1-9a0f-5edb2c0ffedf tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf" status: 200 len: 1724 microversion: 2.20 time: 0.192647 May 19 21:36:23.985223 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 250/490] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:36:23 2022] GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf => generated 1724 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:36:24.096012 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-1ec9a626-451d-4943-bb1d-fa3da5e79745 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:36:24.103803 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1ec9a626-451d-4943-bb1d-fa3da5e79745 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:24.104373 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1ec9a626-451d-4943-bb1d-fa3da5e79745 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:24.168960 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-1ec9a626-451d-4943-bb1d-fa3da5e79745 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] [instance: a392a14d-152c-467f-8031-a4bb8e36e5bb] Going to try to stop instance {{(pid=124349) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 19 21:36:24.218493 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-1ec9a626-451d-4943-bb1d-fa3da5e79745 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] 10.222.0.65 "POST /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb/action" status: 202 len: 0 microversion: 2.1 time: 0.129756 May 19 21:36:24.219107 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 241/491] 10.222.0.65 () {60 vars in 1277 bytes} [Thu May 19 21:36:24 2022] POST /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb/action => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 21:36:24.227339 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-ef9583a9-5035-4310-b2d9-7e95ed24325e tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:36:24.227938 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-ef9583a9-5035-4310-b2d9-7e95ed24325e tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] [instance: a392a14d-152c-467f-8031-a4bb8e36e5bb] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:36:24.236095 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ef9583a9-5035-4310-b2d9-7e95ed24325e tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:24.236637 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ef9583a9-5035-4310-b2d9-7e95ed24325e tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:24.237463 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ef9583a9-5035-4310-b2d9-7e95ed24325e tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:24.237957 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ef9583a9-5035-4310-b2d9-7e95ed24325e tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:24.394711 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-ef9583a9-5035-4310-b2d9-7e95ed24325e tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d16feb169ac46f7983a6b8045de77c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f5916770e9b443489fe7aa76d663fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:24.405853 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-ef9583a9-5035-4310-b2d9-7e95ed24325e tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] 10.222.0.65 "GET /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb" status: 200 len: 1723 microversion: 2.1 time: 0.182225 May 19 21:36:24.407430 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 251/492] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:36:24 2022] GET /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb => generated 1723 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:36:25.003948 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-0564dba4-29a3-4729-9de0-3e486678299a tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:36:25.004659 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-0564dba4-29a3-4729-9de0-3e486678299a tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: e0250d7d-3766-4555-a9af-2429afad53bf] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:36:25.012149 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-0564dba4-29a3-4729-9de0-3e486678299a tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:25.012603 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-0564dba4-29a3-4729-9de0-3e486678299a tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:25.013410 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-0564dba4-29a3-4729-9de0-3e486678299a tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:25.013847 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-0564dba4-29a3-4729-9de0-3e486678299a tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:25.167409 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-0564dba4-29a3-4729-9de0-3e486678299a tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:25.175939 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-0564dba4-29a3-4729-9de0-3e486678299a tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:25.177421 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-0564dba4-29a3-4729-9de0-3e486678299a tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:25.178617 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-0564dba4-29a3-4729-9de0-3e486678299a tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf" status: 200 len: 1724 microversion: 2.20 time: 0.179387 May 19 21:36:25.179177 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 242/493] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:36:24 2022] GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf => generated 1724 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:36:25.424378 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-814e6704-9cfb-41f3-97d3-460352b1e247 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:36:25.425048 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-814e6704-9cfb-41f3-97d3-460352b1e247 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] [instance: a392a14d-152c-467f-8031-a4bb8e36e5bb] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:36:25.432099 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-814e6704-9cfb-41f3-97d3-460352b1e247 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:25.432626 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-814e6704-9cfb-41f3-97d3-460352b1e247 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:25.433448 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-814e6704-9cfb-41f3-97d3-460352b1e247 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:25.433880 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-814e6704-9cfb-41f3-97d3-460352b1e247 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:25.571529 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-814e6704-9cfb-41f3-97d3-460352b1e247 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d16feb169ac46f7983a6b8045de77c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f5916770e9b443489fe7aa76d663fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:25.581200 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-814e6704-9cfb-41f3-97d3-460352b1e247 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] 10.222.0.65 "GET /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb" status: 200 len: 1723 microversion: 2.1 time: 0.160846 May 19 21:36:25.582112 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 252/494] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:36:25 2022] GET /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:36:26.197711 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-00d7203f-f714-4ba5-83ec-ea02049d03ee tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:36:26.198749 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-00d7203f-f714-4ba5-83ec-ea02049d03ee tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: e0250d7d-3766-4555-a9af-2429afad53bf] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:36:26.205775 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-00d7203f-f714-4ba5-83ec-ea02049d03ee tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:26.206338 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-00d7203f-f714-4ba5-83ec-ea02049d03ee tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:26.207143 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-00d7203f-f714-4ba5-83ec-ea02049d03ee tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:26.207664 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-00d7203f-f714-4ba5-83ec-ea02049d03ee tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:26.360381 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-00d7203f-f714-4ba5-83ec-ea02049d03ee tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:26.368801 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-00d7203f-f714-4ba5-83ec-ea02049d03ee tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:26.370404 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-00d7203f-f714-4ba5-83ec-ea02049d03ee tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:26.371570 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-00d7203f-f714-4ba5-83ec-ea02049d03ee tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf" status: 200 len: 1724 microversion: 2.20 time: 0.177908 May 19 21:36:26.372124 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 243/495] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:36:26 2022] GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf => generated 1724 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:36:26.599139 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-8c122774-7846-43b6-adee-2c963f8397ee tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:36:26.599773 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-8c122774-7846-43b6-adee-2c963f8397ee tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] [instance: a392a14d-152c-467f-8031-a4bb8e36e5bb] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:36:26.606905 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8c122774-7846-43b6-adee-2c963f8397ee tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:26.607352 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8c122774-7846-43b6-adee-2c963f8397ee tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:26.608145 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8c122774-7846-43b6-adee-2c963f8397ee tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:26.608571 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8c122774-7846-43b6-adee-2c963f8397ee tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:26.754915 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-8c122774-7846-43b6-adee-2c963f8397ee tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d16feb169ac46f7983a6b8045de77c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f5916770e9b443489fe7aa76d663fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:26.763334 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-8c122774-7846-43b6-adee-2c963f8397ee tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] 10.222.0.65 "GET /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb" status: 200 len: 1723 microversion: 2.1 time: 0.168227 May 19 21:36:26.763912 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 253/496] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:36:26 2022] GET /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:36:27.389496 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-c817e66e-a20f-4dac-89bd-caa562befebc tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:36:27.390086 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-c817e66e-a20f-4dac-89bd-caa562befebc tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: e0250d7d-3766-4555-a9af-2429afad53bf] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:36:27.397155 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c817e66e-a20f-4dac-89bd-caa562befebc tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:27.397602 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c817e66e-a20f-4dac-89bd-caa562befebc tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:27.398404 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c817e66e-a20f-4dac-89bd-caa562befebc tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:27.398836 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c817e66e-a20f-4dac-89bd-caa562befebc tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:27.536123 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-c817e66e-a20f-4dac-89bd-caa562befebc tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:27.545870 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-c817e66e-a20f-4dac-89bd-caa562befebc tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:27.548298 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-c817e66e-a20f-4dac-89bd-caa562befebc tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:27.550117 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-c817e66e-a20f-4dac-89bd-caa562befebc tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf" status: 200 len: 1745 microversion: 2.20 time: 0.164575 May 19 21:36:27.551140 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 244/497] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:36:27 2022] GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf => generated 1745 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:36:27.781291 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-7c9cbf15-5436-4458-a85c-cc63b6a78721 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:36:27.782042 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-7c9cbf15-5436-4458-a85c-cc63b6a78721 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] [instance: a392a14d-152c-467f-8031-a4bb8e36e5bb] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:36:27.789291 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7c9cbf15-5436-4458-a85c-cc63b6a78721 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:27.789826 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7c9cbf15-5436-4458-a85c-cc63b6a78721 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:27.790507 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7c9cbf15-5436-4458-a85c-cc63b6a78721 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:27.790964 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7c9cbf15-5436-4458-a85c-cc63b6a78721 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:27.931056 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-7c9cbf15-5436-4458-a85c-cc63b6a78721 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d16feb169ac46f7983a6b8045de77c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f5916770e9b443489fe7aa76d663fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:27.939413 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-7c9cbf15-5436-4458-a85c-cc63b6a78721 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] 10.222.0.65 "GET /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb" status: 200 len: 1723 microversion: 2.1 time: 0.162102 May 19 21:36:27.940015 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 254/498] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:36:27 2022] GET /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:36:28.571902 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-8779790e-19a2-473b-ab70-308ac6c23179 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:36:28.572628 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-8779790e-19a2-473b-ab70-308ac6c23179 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: e0250d7d-3766-4555-a9af-2429afad53bf] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:36:28.579618 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-8779790e-19a2-473b-ab70-308ac6c23179 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:28.580056 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-8779790e-19a2-473b-ab70-308ac6c23179 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:28.580828 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-8779790e-19a2-473b-ab70-308ac6c23179 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:28.581249 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-8779790e-19a2-473b-ab70-308ac6c23179 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:28.724684 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-8779790e-19a2-473b-ab70-308ac6c23179 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:28.733899 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-8779790e-19a2-473b-ab70-308ac6c23179 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:28.735427 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-8779790e-19a2-473b-ab70-308ac6c23179 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:28.736580 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-8779790e-19a2-473b-ab70-308ac6c23179 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf" status: 200 len: 1745 microversion: 2.20 time: 0.168682 May 19 21:36:28.737134 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 245/499] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:36:28 2022] GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf => generated 1745 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:36:28.876534 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-f3761101-7967-441f-bdb1-16c726c87755 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6f2e80e3-f6aa-4301-8f4e-249305e3516a", "device": "/dev/sdb"}} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:36:28.878225 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-f3761101-7967-441f-bdb1-16c726c87755 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] [instance: 8b820379-bb78-465a-a84d-7c1e945c74da] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:36:28.885461 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f3761101-7967-441f-bdb1-16c726c87755 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:28.885771 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f3761101-7967-441f-bdb1-16c726c87755 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:28.886590 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f3761101-7967-441f-bdb1-16c726c87755 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:28.887025 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f3761101-7967-441f-bdb1-16c726c87755 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:28.956828 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-a99406b0-98e8-4c12-b897-c1cb71bd174b tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:36:28.957440 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-a99406b0-98e8-4c12-b897-c1cb71bd174b tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] [instance: a392a14d-152c-467f-8031-a4bb8e36e5bb] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:36:28.964806 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a99406b0-98e8-4c12-b897-c1cb71bd174b tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:28.965255 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a99406b0-98e8-4c12-b897-c1cb71bd174b tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:28.966035 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a99406b0-98e8-4c12-b897-c1cb71bd174b tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:28.966494 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a99406b0-98e8-4c12-b897-c1cb71bd174b tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:29.125204 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-a99406b0-98e8-4c12-b897-c1cb71bd174b tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d16feb169ac46f7983a6b8045de77c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f5916770e9b443489fe7aa76d663fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:29.133353 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-a99406b0-98e8-4c12-b897-c1cb71bd174b tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] 10.222.0.65 "GET /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb" status: 200 len: 1723 microversion: 2.1 time: 0.180424 May 19 21:36:29.134005 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 246/500] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:36:28 2022] GET /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb => generated 1723 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:36:29.167381 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-f3761101-7967-441f-bdb1-16c726c87755 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] 10.222.0.65 "POST /compute/v2.1/servers/8b820379-bb78-465a-a84d-7c1e945c74da/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.294622 May 19 21:36:29.168123 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 255/501] 10.222.0.65 () {60 vars in 1322 bytes} [Thu May 19 21:36:28 2022] POST /compute/v2.1/servers/8b820379-bb78-465a-a84d-7c1e945c74da/os-volume_attachments => generated 194 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 21:36:29.756043 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-4f12aeb7-d403-4b95-8065-c5ea5d94484b tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:36:29.756661 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-4f12aeb7-d403-4b95-8065-c5ea5d94484b tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: e0250d7d-3766-4555-a9af-2429afad53bf] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:36:29.764035 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-4f12aeb7-d403-4b95-8065-c5ea5d94484b tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:29.764506 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-4f12aeb7-d403-4b95-8065-c5ea5d94484b tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:29.765277 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-4f12aeb7-d403-4b95-8065-c5ea5d94484b tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:29.765705 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-4f12aeb7-d403-4b95-8065-c5ea5d94484b tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:29.917803 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-4f12aeb7-d403-4b95-8065-c5ea5d94484b tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:29.926864 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-4f12aeb7-d403-4b95-8065-c5ea5d94484b tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:29.928411 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-4f12aeb7-d403-4b95-8065-c5ea5d94484b tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:29.929567 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-4f12aeb7-d403-4b95-8065-c5ea5d94484b tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf" status: 200 len: 1745 microversion: 2.20 time: 0.177547 May 19 21:36:29.930155 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 247/502] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:36:29 2022] GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf => generated 1745 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:36:30.159887 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-8cc34785-273e-4b6c-9b95-db9e6b2dcb54 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:36:30.160562 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-8cc34785-273e-4b6c-9b95-db9e6b2dcb54 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] [instance: a392a14d-152c-467f-8031-a4bb8e36e5bb] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:36:30.169320 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8cc34785-273e-4b6c-9b95-db9e6b2dcb54 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:30.169770 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8cc34785-273e-4b6c-9b95-db9e6b2dcb54 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:30.170595 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8cc34785-273e-4b6c-9b95-db9e6b2dcb54 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:30.171052 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8cc34785-273e-4b6c-9b95-db9e6b2dcb54 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:30.333508 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-8cc34785-273e-4b6c-9b95-db9e6b2dcb54 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d16feb169ac46f7983a6b8045de77c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f5916770e9b443489fe7aa76d663fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:30.344116 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-8cc34785-273e-4b6c-9b95-db9e6b2dcb54 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] 10.222.0.65 "GET /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb" status: 200 len: 1723 microversion: 2.1 time: 0.189059 May 19 21:36:30.344745 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 256/503] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:36:30 2022] GET /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb => generated 1723 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 21:36:30.949811 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-c22e6912-db9d-431a-83e5-4018f17aa7d7 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:36:30.950488 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-c22e6912-db9d-431a-83e5-4018f17aa7d7 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: e0250d7d-3766-4555-a9af-2429afad53bf] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:36:30.957867 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c22e6912-db9d-431a-83e5-4018f17aa7d7 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:30.958321 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c22e6912-db9d-431a-83e5-4018f17aa7d7 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:30.959112 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c22e6912-db9d-431a-83e5-4018f17aa7d7 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:30.959547 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c22e6912-db9d-431a-83e5-4018f17aa7d7 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:31.104998 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-c22e6912-db9d-431a-83e5-4018f17aa7d7 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:31.121918 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-c22e6912-db9d-431a-83e5-4018f17aa7d7 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:31.123488 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-c22e6912-db9d-431a-83e5-4018f17aa7d7 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:31.124654 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-c22e6912-db9d-431a-83e5-4018f17aa7d7 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf" status: 200 len: 1745 microversion: 2.20 time: 0.179864 May 19 21:36:31.125213 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 248/504] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:36:30 2022] GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf => generated 1745 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:36:31.367352 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-9c7f398e-9042-4ebc-ba7a-6535e550431a tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:36:31.368072 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-9c7f398e-9042-4ebc-ba7a-6535e550431a tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] [instance: a392a14d-152c-467f-8031-a4bb8e36e5bb] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:36:31.375736 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9c7f398e-9042-4ebc-ba7a-6535e550431a tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:31.376188 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9c7f398e-9042-4ebc-ba7a-6535e550431a tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:31.376983 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9c7f398e-9042-4ebc-ba7a-6535e550431a tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:31.377415 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9c7f398e-9042-4ebc-ba7a-6535e550431a tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:31.523259 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-9c7f398e-9042-4ebc-ba7a-6535e550431a tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d16feb169ac46f7983a6b8045de77c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f5916770e9b443489fe7aa76d663fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:31.533338 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-9c7f398e-9042-4ebc-ba7a-6535e550431a tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] 10.222.0.65 "GET /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb" status: 200 len: 1723 microversion: 2.1 time: 0.170217 May 19 21:36:31.533913 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 257/505] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:36:31 2022] GET /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:36:31.927919 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [req-86a67a11-77ab-40e3-bf4e-5e3282c0943b req-3176905f-340e-4cc3-af8b-cc39af121e16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0250d7d-3766-4555-a9af-2429afad53bf", "name": "network-vif-plugged", "status": "completed", "tag": "7fe0112e-1449-4e73-9fa1-f6d3a33168d8"}]} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:36:31.936822 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-86a67a11-77ab-40e3-bf4e-5e3282c0943b req-3176905f-340e-4cc3-af8b-cc39af121e16 service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:31.937266 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-86a67a11-77ab-40e3-bf4e-5e3282c0943b req-3176905f-340e-4cc3-af8b-cc39af121e16 service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:31.950660 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.compute.server_external_events [req-86a67a11-77ab-40e3-bf4e-5e3282c0943b req-3176905f-340e-4cc3-af8b-cc39af121e16 service nova] Creating event network-vif-plugged:7fe0112e-1449-4e73-9fa1-f6d3a33168d8 for instance e0250d7d-3766-4555-a9af-2429afad53bf on hv-cinder-83563 May 19 21:36:31.955585 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [req-86a67a11-77ab-40e3-bf4e-5e3282c0943b req-3176905f-340e-4cc3-af8b-cc39af121e16 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031835 May 19 21:36:31.956260 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 249/506] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 21:36:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 21:36:32.146070 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-1dd56641-b19a-4549-9199-7317ec1cebb5 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:36:32.146880 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-1dd56641-b19a-4549-9199-7317ec1cebb5 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: e0250d7d-3766-4555-a9af-2429afad53bf] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:36:32.154865 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1dd56641-b19a-4549-9199-7317ec1cebb5 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:32.155307 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1dd56641-b19a-4549-9199-7317ec1cebb5 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:32.156059 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1dd56641-b19a-4549-9199-7317ec1cebb5 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:32.156487 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1dd56641-b19a-4549-9199-7317ec1cebb5 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:32.298629 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-1dd56641-b19a-4549-9199-7317ec1cebb5 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:32.307371 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-1dd56641-b19a-4549-9199-7317ec1cebb5 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:32.308855 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-1dd56641-b19a-4549-9199-7317ec1cebb5 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:32.309990 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-1dd56641-b19a-4549-9199-7317ec1cebb5 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf" status: 200 len: 1745 microversion: 2.20 time: 0.169714 May 19 21:36:32.310579 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 258/507] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:36:32 2022] GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf => generated 1745 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:36:32.556039 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-e79d2185-b05b-45e1-81d6-33be5bda01d0 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:36:32.557057 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-e79d2185-b05b-45e1-81d6-33be5bda01d0 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] [instance: a392a14d-152c-467f-8031-a4bb8e36e5bb] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:36:32.567021 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e79d2185-b05b-45e1-81d6-33be5bda01d0 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:32.567726 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e79d2185-b05b-45e1-81d6-33be5bda01d0 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:32.568919 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e79d2185-b05b-45e1-81d6-33be5bda01d0 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:32.569596 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e79d2185-b05b-45e1-81d6-33be5bda01d0 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:32.722139 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-e79d2185-b05b-45e1-81d6-33be5bda01d0 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d16feb169ac46f7983a6b8045de77c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f5916770e9b443489fe7aa76d663fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:32.732561 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-e79d2185-b05b-45e1-81d6-33be5bda01d0 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] 10.222.0.65 "GET /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb" status: 200 len: 1723 microversion: 2.1 time: 0.183253 May 19 21:36:32.733323 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 250/508] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:36:32 2022] GET /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb => generated 1723 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:36:33.336367 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-8de7ba69-b0de-476a-9607-4911c2cd472f tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:36:33.336962 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-8de7ba69-b0de-476a-9607-4911c2cd472f tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: e0250d7d-3766-4555-a9af-2429afad53bf] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:36:33.347976 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8de7ba69-b0de-476a-9607-4911c2cd472f tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:33.348565 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8de7ba69-b0de-476a-9607-4911c2cd472f tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:33.349726 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8de7ba69-b0de-476a-9607-4911c2cd472f tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:33.350316 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8de7ba69-b0de-476a-9607-4911c2cd472f tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:33.493492 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-8de7ba69-b0de-476a-9607-4911c2cd472f tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:33.504356 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-8de7ba69-b0de-476a-9607-4911c2cd472f tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:33.505852 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-8de7ba69-b0de-476a-9607-4911c2cd472f tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:33.507040 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-8de7ba69-b0de-476a-9607-4911c2cd472f tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf" status: 200 len: 1745 microversion: 2.20 time: 0.176655 May 19 21:36:33.507582 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 259/509] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:36:33 2022] GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf => generated 1745 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:36:33.754185 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-83367271-cf28-4bc0-8ab2-2e16f234b196 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:36:33.754786 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-83367271-cf28-4bc0-8ab2-2e16f234b196 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] [instance: a392a14d-152c-467f-8031-a4bb8e36e5bb] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:36:33.762485 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-83367271-cf28-4bc0-8ab2-2e16f234b196 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:33.766509 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-83367271-cf28-4bc0-8ab2-2e16f234b196 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:33.766509 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-83367271-cf28-4bc0-8ab2-2e16f234b196 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:33.766509 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-83367271-cf28-4bc0-8ab2-2e16f234b196 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:33.782232 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:36:33.910215 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-83367271-cf28-4bc0-8ab2-2e16f234b196 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d16feb169ac46f7983a6b8045de77c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f5916770e9b443489fe7aa76d663fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:33.918916 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-83367271-cf28-4bc0-8ab2-2e16f234b196 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] 10.222.0.65 "GET /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb" status: 200 len: 1723 microversion: 2.1 time: 0.168745 May 19 21:36:33.919482 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 251/510] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:36:33 2022] GET /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:36:34.525460 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-3ab444a6-18ae-4dd4-a9e7-0fed5491d02d tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:36:34.526177 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-3ab444a6-18ae-4dd4-a9e7-0fed5491d02d tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: e0250d7d-3766-4555-a9af-2429afad53bf] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:36:34.533181 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3ab444a6-18ae-4dd4-a9e7-0fed5491d02d tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:34.533624 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3ab444a6-18ae-4dd4-a9e7-0fed5491d02d tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:34.534553 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3ab444a6-18ae-4dd4-a9e7-0fed5491d02d tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:34.534910 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3ab444a6-18ae-4dd4-a9e7-0fed5491d02d tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:34.670514 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-3ab444a6-18ae-4dd4-a9e7-0fed5491d02d tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:34.678892 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-3ab444a6-18ae-4dd4-a9e7-0fed5491d02d tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:34.680404 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-3ab444a6-18ae-4dd4-a9e7-0fed5491d02d tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:34.681565 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-3ab444a6-18ae-4dd4-a9e7-0fed5491d02d tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf" status: 200 len: 1745 microversion: 2.20 time: 0.160201 May 19 21:36:34.682263 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 260/511] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:36:34 2022] GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf => generated 1745 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:36:34.939377 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-328cc69e-4d7d-4b3b-92eb-95c2f79548b3 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:36:34.939926 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-328cc69e-4d7d-4b3b-92eb-95c2f79548b3 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] [instance: a392a14d-152c-467f-8031-a4bb8e36e5bb] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:36:34.949536 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-328cc69e-4d7d-4b3b-92eb-95c2f79548b3 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:34.950141 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-328cc69e-4d7d-4b3b-92eb-95c2f79548b3 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:34.951265 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-328cc69e-4d7d-4b3b-92eb-95c2f79548b3 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:34.951761 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-328cc69e-4d7d-4b3b-92eb-95c2f79548b3 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:35.095937 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-328cc69e-4d7d-4b3b-92eb-95c2f79548b3 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d16feb169ac46f7983a6b8045de77c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f5916770e9b443489fe7aa76d663fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:35.105258 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-328cc69e-4d7d-4b3b-92eb-95c2f79548b3 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] 10.222.0.65 "GET /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb" status: 200 len: 1723 microversion: 2.1 time: 0.172151 May 19 21:36:35.105850 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 252/512] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:36:34 2022] GET /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:36:35.704046 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-0d710716-9e6a-4e81-b595-b94caea74607 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:36:35.704611 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-0d710716-9e6a-4e81-b595-b94caea74607 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: e0250d7d-3766-4555-a9af-2429afad53bf] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:36:35.711543 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0d710716-9e6a-4e81-b595-b94caea74607 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:35.711979 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0d710716-9e6a-4e81-b595-b94caea74607 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:35.713051 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0d710716-9e6a-4e81-b595-b94caea74607 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:35.713552 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0d710716-9e6a-4e81-b595-b94caea74607 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:35.861161 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-0d710716-9e6a-4e81-b595-b94caea74607 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:35.869841 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-0d710716-9e6a-4e81-b595-b94caea74607 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:35.871467 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-0d710716-9e6a-4e81-b595-b94caea74607 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:35.872626 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-0d710716-9e6a-4e81-b595-b94caea74607 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf" status: 200 len: 1745 microversion: 2.20 time: 0.172534 May 19 21:36:35.873156 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 261/513] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:36:35 2022] GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf => generated 1745 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:36:36.123233 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-5ba73741-409f-4b6f-b81c-1c56b88fceb8 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:36:36.123833 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-5ba73741-409f-4b6f-b81c-1c56b88fceb8 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] [instance: a392a14d-152c-467f-8031-a4bb8e36e5bb] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:36:36.130966 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-5ba73741-409f-4b6f-b81c-1c56b88fceb8 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:36.131412 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-5ba73741-409f-4b6f-b81c-1c56b88fceb8 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:36.132176 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-5ba73741-409f-4b6f-b81c-1c56b88fceb8 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:36.132600 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-5ba73741-409f-4b6f-b81c-1c56b88fceb8 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:36.280399 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-5ba73741-409f-4b6f-b81c-1c56b88fceb8 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d16feb169ac46f7983a6b8045de77c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f5916770e9b443489fe7aa76d663fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:36.292638 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-5ba73741-409f-4b6f-b81c-1c56b88fceb8 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] 10.222.0.65 "GET /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb" status: 200 len: 1723 microversion: 2.1 time: 0.173414 May 19 21:36:36.293216 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 253/514] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:36:36 2022] GET /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb => generated 1723 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:36:36.892095 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-9078b758-3def-4bdc-ac44-824ed0f35b4a tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:36:36.892700 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-9078b758-3def-4bdc-ac44-824ed0f35b4a tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: e0250d7d-3766-4555-a9af-2429afad53bf] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:36:36.899432 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9078b758-3def-4bdc-ac44-824ed0f35b4a tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:36.899878 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9078b758-3def-4bdc-ac44-824ed0f35b4a tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:36.900729 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9078b758-3def-4bdc-ac44-824ed0f35b4a tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:36.901366 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9078b758-3def-4bdc-ac44-824ed0f35b4a tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:37.081414 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-9078b758-3def-4bdc-ac44-824ed0f35b4a tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:37.093217 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-9078b758-3def-4bdc-ac44-824ed0f35b4a tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:37.094758 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-9078b758-3def-4bdc-ac44-824ed0f35b4a tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:37.097333 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-9078b758-3def-4bdc-ac44-824ed0f35b4a tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf" status: 200 len: 1740 microversion: 2.20 time: 0.209031 May 19 21:36:37.102372 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 262/515] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:36:36 2022] GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf => generated 1740 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:36:37.316242 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-5f7afd89-7884-40d9-92aa-48bf0488cefa tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:36:37.316807 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-5f7afd89-7884-40d9-92aa-48bf0488cefa tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] [instance: a392a14d-152c-467f-8031-a4bb8e36e5bb] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:36:37.326408 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-5f7afd89-7884-40d9-92aa-48bf0488cefa tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:37.326869 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-5f7afd89-7884-40d9-92aa-48bf0488cefa tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:37.328108 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-5f7afd89-7884-40d9-92aa-48bf0488cefa tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:37.328848 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-5f7afd89-7884-40d9-92aa-48bf0488cefa tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:37.498356 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-5f7afd89-7884-40d9-92aa-48bf0488cefa tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d16feb169ac46f7983a6b8045de77c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f5916770e9b443489fe7aa76d663fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:37.508332 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-5f7afd89-7884-40d9-92aa-48bf0488cefa tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] 10.222.0.65 "GET /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb" status: 200 len: 1723 microversion: 2.1 time: 0.196550 May 19 21:36:37.519473 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 254/516] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:36:37 2022] GET /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb => generated 1723 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:36:38.118755 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-486b225b-9f74-43fe-9cac-49a2b80c0321 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:36:38.119995 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-486b225b-9f74-43fe-9cac-49a2b80c0321 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: e0250d7d-3766-4555-a9af-2429afad53bf] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:36:38.127340 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-486b225b-9f74-43fe-9cac-49a2b80c0321 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:38.127801 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-486b225b-9f74-43fe-9cac-49a2b80c0321 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:38.128555 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-486b225b-9f74-43fe-9cac-49a2b80c0321 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:38.129166 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-486b225b-9f74-43fe-9cac-49a2b80c0321 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:38.279099 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-486b225b-9f74-43fe-9cac-49a2b80c0321 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:38.288111 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-486b225b-9f74-43fe-9cac-49a2b80c0321 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:38.289942 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-486b225b-9f74-43fe-9cac-49a2b80c0321 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:38.292897 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-486b225b-9f74-43fe-9cac-49a2b80c0321 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf" status: 200 len: 1740 microversion: 2.20 time: 0.177872 May 19 21:36:38.293875 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 263/517] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:36:38 2022] GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf => generated 1740 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 21:36:38.527793 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-52899e73-ae05-43a7-97c2-d6d2f3ee931c tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:36:38.529232 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-52899e73-ae05-43a7-97c2-d6d2f3ee931c tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] [instance: a392a14d-152c-467f-8031-a4bb8e36e5bb] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:36:38.551988 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-52899e73-ae05-43a7-97c2-d6d2f3ee931c tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:38.552829 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-52899e73-ae05-43a7-97c2-d6d2f3ee931c tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:38.553859 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-52899e73-ae05-43a7-97c2-d6d2f3ee931c tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:38.554541 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-52899e73-ae05-43a7-97c2-d6d2f3ee931c tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:38.711537 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-52899e73-ae05-43a7-97c2-d6d2f3ee931c tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d16feb169ac46f7983a6b8045de77c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f5916770e9b443489fe7aa76d663fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:38.724010 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-52899e73-ae05-43a7-97c2-d6d2f3ee931c tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] 10.222.0.65 "GET /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb" status: 200 len: 1723 microversion: 2.1 time: 0.200303 May 19 21:36:38.724598 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 255/518] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:36:38 2022] GET /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb => generated 1723 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:36:39.317219 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-445a75ba-3191-472c-a49d-9b86275e0692 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:36:39.318589 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-445a75ba-3191-472c-a49d-9b86275e0692 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: e0250d7d-3766-4555-a9af-2429afad53bf] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:36:39.325606 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-445a75ba-3191-472c-a49d-9b86275e0692 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:39.326414 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-445a75ba-3191-472c-a49d-9b86275e0692 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:39.327590 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-445a75ba-3191-472c-a49d-9b86275e0692 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:39.328085 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-445a75ba-3191-472c-a49d-9b86275e0692 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:39.514528 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-445a75ba-3191-472c-a49d-9b86275e0692 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:39.526370 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-445a75ba-3191-472c-a49d-9b86275e0692 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:39.528362 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-445a75ba-3191-472c-a49d-9b86275e0692 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:39.529639 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-445a75ba-3191-472c-a49d-9b86275e0692 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf" status: 200 len: 1740 microversion: 2.20 time: 0.221697 May 19 21:36:39.530290 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 264/519] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:36:39 2022] GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf => generated 1740 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:36:39.741469 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-36dfef62-16ea-48ac-86c4-2523ca7d2b49 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:36:39.742160 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-36dfef62-16ea-48ac-86c4-2523ca7d2b49 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] [instance: a392a14d-152c-467f-8031-a4bb8e36e5bb] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:36:39.749557 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-36dfef62-16ea-48ac-86c4-2523ca7d2b49 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:39.750008 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-36dfef62-16ea-48ac-86c4-2523ca7d2b49 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:39.750833 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-36dfef62-16ea-48ac-86c4-2523ca7d2b49 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:39.751273 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-36dfef62-16ea-48ac-86c4-2523ca7d2b49 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:39.931416 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-36dfef62-16ea-48ac-86c4-2523ca7d2b49 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d16feb169ac46f7983a6b8045de77c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f5916770e9b443489fe7aa76d663fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:39.952686 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-36dfef62-16ea-48ac-86c4-2523ca7d2b49 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] 10.222.0.65 "GET /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb" status: 200 len: 1723 microversion: 2.1 time: 0.215260 May 19 21:36:39.953283 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 256/520] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:36:39 2022] GET /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb => generated 1723 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:36:40.552436 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-aeddeeaa-3d9a-4d1f-bdc1-36ddb0a1f582 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:36:40.553762 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-aeddeeaa-3d9a-4d1f-bdc1-36ddb0a1f582 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: e0250d7d-3766-4555-a9af-2429afad53bf] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:36:40.560341 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-aeddeeaa-3d9a-4d1f-bdc1-36ddb0a1f582 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:40.560859 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-aeddeeaa-3d9a-4d1f-bdc1-36ddb0a1f582 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:40.562168 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-aeddeeaa-3d9a-4d1f-bdc1-36ddb0a1f582 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:40.563406 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-aeddeeaa-3d9a-4d1f-bdc1-36ddb0a1f582 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:40.568501 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:36:40.731327 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-aeddeeaa-3d9a-4d1f-bdc1-36ddb0a1f582 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:40.740908 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-aeddeeaa-3d9a-4d1f-bdc1-36ddb0a1f582 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:40.742707 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-aeddeeaa-3d9a-4d1f-bdc1-36ddb0a1f582 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:40.743868 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-aeddeeaa-3d9a-4d1f-bdc1-36ddb0a1f582 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf" status: 200 len: 1740 microversion: 2.20 time: 0.198833 May 19 21:36:40.744661 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 265/521] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:36:40 2022] GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf => generated 1740 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:36:40.971044 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-ec42455a-4cae-420c-942d-50e5e25393cb tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:36:40.971670 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-ec42455a-4cae-420c-942d-50e5e25393cb tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] [instance: a392a14d-152c-467f-8031-a4bb8e36e5bb] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:36:40.980537 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ec42455a-4cae-420c-942d-50e5e25393cb tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:40.981240 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ec42455a-4cae-420c-942d-50e5e25393cb tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:40.982210 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ec42455a-4cae-420c-942d-50e5e25393cb tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:40.982665 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ec42455a-4cae-420c-942d-50e5e25393cb tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:41.142162 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-ec42455a-4cae-420c-942d-50e5e25393cb tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d16feb169ac46f7983a6b8045de77c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f5916770e9b443489fe7aa76d663fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:41.151014 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-ec42455a-4cae-420c-942d-50e5e25393cb tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] 10.222.0.65 "GET /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb" status: 200 len: 1723 microversion: 2.1 time: 0.183974 May 19 21:36:41.160986 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 257/522] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:36:40 2022] GET /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb => generated 1723 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:36:41.763006 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-356bf2f5-740c-49c5-8345-b5b65420d0ac tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:36:41.763731 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-356bf2f5-740c-49c5-8345-b5b65420d0ac tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: e0250d7d-3766-4555-a9af-2429afad53bf] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:36:41.768759 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_api:SELECT=44 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:36:41.772771 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-356bf2f5-740c-49c5-8345-b5b65420d0ac tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:41.773142 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-356bf2f5-740c-49c5-8345-b5b65420d0ac tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:41.774004 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-356bf2f5-740c-49c5-8345-b5b65420d0ac tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:41.774477 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-356bf2f5-740c-49c5-8345-b5b65420d0ac tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:41.928551 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-356bf2f5-740c-49c5-8345-b5b65420d0ac tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:41.937526 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-356bf2f5-740c-49c5-8345-b5b65420d0ac tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:41.939064 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-356bf2f5-740c-49c5-8345-b5b65420d0ac tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:41.940263 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-356bf2f5-740c-49c5-8345-b5b65420d0ac tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf" status: 200 len: 1740 microversion: 2.20 time: 0.181429 May 19 21:36:41.940776 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 266/523] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:36:41 2022] GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf => generated 1740 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:36:42.171538 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-778183b4-51b8-48ad-ad77-6802f89fd5e8 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:36:42.172465 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-778183b4-51b8-48ad-ad77-6802f89fd5e8 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] [instance: a392a14d-152c-467f-8031-a4bb8e36e5bb] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:36:42.181185 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-778183b4-51b8-48ad-ad77-6802f89fd5e8 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:42.182114 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-778183b4-51b8-48ad-ad77-6802f89fd5e8 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:42.183328 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-778183b4-51b8-48ad-ad77-6802f89fd5e8 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:42.183956 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-778183b4-51b8-48ad-ad77-6802f89fd5e8 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:42.341303 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-778183b4-51b8-48ad-ad77-6802f89fd5e8 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d16feb169ac46f7983a6b8045de77c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f5916770e9b443489fe7aa76d663fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:42.350486 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-778183b4-51b8-48ad-ad77-6802f89fd5e8 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] 10.222.0.65 "GET /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb" status: 200 len: 1723 microversion: 2.1 time: 0.184993 May 19 21:36:42.350991 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 258/524] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:36:42 2022] GET /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb => generated 1723 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:36:42.959377 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-ca2c9cc6-af1f-4f4d-8684-9a5e5a283055 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:36:42.960698 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-ca2c9cc6-af1f-4f4d-8684-9a5e5a283055 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: e0250d7d-3766-4555-a9af-2429afad53bf] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:36:42.968048 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ca2c9cc6-af1f-4f4d-8684-9a5e5a283055 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:42.968767 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ca2c9cc6-af1f-4f4d-8684-9a5e5a283055 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:42.970428 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ca2c9cc6-af1f-4f4d-8684-9a5e5a283055 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:42.971011 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ca2c9cc6-af1f-4f4d-8684-9a5e5a283055 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:43.145787 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-ca2c9cc6-af1f-4f4d-8684-9a5e5a283055 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:43.156918 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-ca2c9cc6-af1f-4f4d-8684-9a5e5a283055 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:43.158500 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-ca2c9cc6-af1f-4f4d-8684-9a5e5a283055 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:43.159871 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-ca2c9cc6-af1f-4f4d-8684-9a5e5a283055 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf" status: 200 len: 1740 microversion: 2.20 time: 0.204628 May 19 21:36:43.160740 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 267/525] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:36:42 2022] GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf => generated 1740 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:36:43.370689 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-0b1fda41-a6d3-463c-894b-4952ab07b762 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:36:43.373003 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-0b1fda41-a6d3-463c-894b-4952ab07b762 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] [instance: a392a14d-152c-467f-8031-a4bb8e36e5bb] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:36:43.385770 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-0b1fda41-a6d3-463c-894b-4952ab07b762 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:43.386787 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-0b1fda41-a6d3-463c-894b-4952ab07b762 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:43.387783 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-0b1fda41-a6d3-463c-894b-4952ab07b762 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:43.388514 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-0b1fda41-a6d3-463c-894b-4952ab07b762 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:43.574784 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-0b1fda41-a6d3-463c-894b-4952ab07b762 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d16feb169ac46f7983a6b8045de77c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f5916770e9b443489fe7aa76d663fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:43.584177 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-0b1fda41-a6d3-463c-894b-4952ab07b762 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] 10.222.0.65 "GET /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb" status: 200 len: 1723 microversion: 2.1 time: 0.218884 May 19 21:36:43.584839 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 259/526] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:36:43 2022] GET /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb => generated 1723 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:36:44.179693 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-e132c980-a65f-4dd3-9404-983182101459 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:36:44.180257 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-e132c980-a65f-4dd3-9404-983182101459 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: e0250d7d-3766-4555-a9af-2429afad53bf] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:36:44.188597 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e132c980-a65f-4dd3-9404-983182101459 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:44.189041 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e132c980-a65f-4dd3-9404-983182101459 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:44.189851 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e132c980-a65f-4dd3-9404-983182101459 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:44.190304 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e132c980-a65f-4dd3-9404-983182101459 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:44.344662 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-e132c980-a65f-4dd3-9404-983182101459 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:44.354104 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-e132c980-a65f-4dd3-9404-983182101459 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:44.355662 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-e132c980-a65f-4dd3-9404-983182101459 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:44.356819 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-e132c980-a65f-4dd3-9404-983182101459 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf" status: 200 len: 1740 microversion: 2.20 time: 0.181832 May 19 21:36:44.357381 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 268/527] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:36:44 2022] GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf => generated 1740 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:36:44.601074 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-ea5145f9-8611-46db-9fbb-7e26e917c305 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:36:44.602664 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-ea5145f9-8611-46db-9fbb-7e26e917c305 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] [instance: a392a14d-152c-467f-8031-a4bb8e36e5bb] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:36:44.605297 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_api:SELECT=48 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:36:44.611479 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ea5145f9-8611-46db-9fbb-7e26e917c305 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:44.612151 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ea5145f9-8611-46db-9fbb-7e26e917c305 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:44.613129 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ea5145f9-8611-46db-9fbb-7e26e917c305 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:44.613564 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ea5145f9-8611-46db-9fbb-7e26e917c305 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:44.760770 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-ea5145f9-8611-46db-9fbb-7e26e917c305 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d16feb169ac46f7983a6b8045de77c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f5916770e9b443489fe7aa76d663fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:44.772473 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-ea5145f9-8611-46db-9fbb-7e26e917c305 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] 10.222.0.65 "GET /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb" status: 200 len: 1723 microversion: 2.1 time: 0.175231 May 19 21:36:44.773322 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 260/528] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:36:44 2022] GET /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:36:45.375357 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-9e6f6601-1837-453b-87fb-4d957e9d8209 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:36:45.377089 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-9e6f6601-1837-453b-87fb-4d957e9d8209 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: e0250d7d-3766-4555-a9af-2429afad53bf] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:36:45.384894 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9e6f6601-1837-453b-87fb-4d957e9d8209 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:45.385615 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9e6f6601-1837-453b-87fb-4d957e9d8209 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:45.386675 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9e6f6601-1837-453b-87fb-4d957e9d8209 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:45.387295 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9e6f6601-1837-453b-87fb-4d957e9d8209 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:45.540763 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-9e6f6601-1837-453b-87fb-4d957e9d8209 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:45.550775 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-9e6f6601-1837-453b-87fb-4d957e9d8209 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:45.552553 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-9e6f6601-1837-453b-87fb-4d957e9d8209 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:45.553718 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-9e6f6601-1837-453b-87fb-4d957e9d8209 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf" status: 200 len: 1740 microversion: 2.20 time: 0.182370 May 19 21:36:45.554276 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 269/529] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:36:45 2022] GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf => generated 1740 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:36:45.789994 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-668ae4b9-5bb4-4d64-8cf9-fc1ed78e1dcb tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:36:45.790738 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-668ae4b9-5bb4-4d64-8cf9-fc1ed78e1dcb tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] [instance: a392a14d-152c-467f-8031-a4bb8e36e5bb] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:36:45.797713 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-668ae4b9-5bb4-4d64-8cf9-fc1ed78e1dcb tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:45.798154 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-668ae4b9-5bb4-4d64-8cf9-fc1ed78e1dcb tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:45.798956 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-668ae4b9-5bb4-4d64-8cf9-fc1ed78e1dcb tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:45.799385 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-668ae4b9-5bb4-4d64-8cf9-fc1ed78e1dcb tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:45.951940 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-668ae4b9-5bb4-4d64-8cf9-fc1ed78e1dcb tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d16feb169ac46f7983a6b8045de77c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f5916770e9b443489fe7aa76d663fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:45.960097 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-668ae4b9-5bb4-4d64-8cf9-fc1ed78e1dcb tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] 10.222.0.65 "GET /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb" status: 200 len: 1723 microversion: 2.1 time: 0.174300 May 19 21:36:45.960841 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 261/530] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:36:45 2022] GET /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:36:46.575472 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-d974633a-13dc-45fa-86b6-c6493ce22b20 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:36:46.576090 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-d974633a-13dc-45fa-86b6-c6493ce22b20 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: e0250d7d-3766-4555-a9af-2429afad53bf] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:36:46.582510 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d974633a-13dc-45fa-86b6-c6493ce22b20 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:46.582979 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d974633a-13dc-45fa-86b6-c6493ce22b20 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:46.583724 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d974633a-13dc-45fa-86b6-c6493ce22b20 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:46.584138 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d974633a-13dc-45fa-86b6-c6493ce22b20 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:46.748063 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-d974633a-13dc-45fa-86b6-c6493ce22b20 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:46.756297 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-d974633a-13dc-45fa-86b6-c6493ce22b20 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:46.757785 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-d974633a-13dc-45fa-86b6-c6493ce22b20 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:46.758990 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-d974633a-13dc-45fa-86b6-c6493ce22b20 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf" status: 200 len: 1740 microversion: 2.20 time: 0.188620 May 19 21:36:46.759684 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 270/531] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:36:46 2022] GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf => generated 1740 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:36:46.979558 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-d9c264c9-8f58-43a4-bc30-184498063db1 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:36:46.980485 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-d9c264c9-8f58-43a4-bc30-184498063db1 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] [instance: a392a14d-152c-467f-8031-a4bb8e36e5bb] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:36:46.990796 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-d9c264c9-8f58-43a4-bc30-184498063db1 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:46.991396 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-d9c264c9-8f58-43a4-bc30-184498063db1 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:46.992471 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-d9c264c9-8f58-43a4-bc30-184498063db1 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:46.992895 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-d9c264c9-8f58-43a4-bc30-184498063db1 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:47.143319 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-d9c264c9-8f58-43a4-bc30-184498063db1 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d16feb169ac46f7983a6b8045de77c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f5916770e9b443489fe7aa76d663fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:47.152161 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-d9c264c9-8f58-43a4-bc30-184498063db1 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] 10.222.0.65 "GET /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb" status: 200 len: 1723 microversion: 2.1 time: 0.177767 May 19 21:36:47.152755 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 262/532] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:36:46 2022] GET /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb => generated 1723 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:36:47.778487 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-8ea1b165-0130-4ba0-96db-60bfd816232e tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:36:47.779057 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-8ea1b165-0130-4ba0-96db-60bfd816232e tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: e0250d7d-3766-4555-a9af-2429afad53bf] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:36:47.788090 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8ea1b165-0130-4ba0-96db-60bfd816232e tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:47.788538 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8ea1b165-0130-4ba0-96db-60bfd816232e tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:47.789289 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8ea1b165-0130-4ba0-96db-60bfd816232e tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:47.789712 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8ea1b165-0130-4ba0-96db-60bfd816232e tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:47.931763 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-8ea1b165-0130-4ba0-96db-60bfd816232e tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:47.940158 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-8ea1b165-0130-4ba0-96db-60bfd816232e tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:47.942855 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-8ea1b165-0130-4ba0-96db-60bfd816232e tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:47.944971 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-8ea1b165-0130-4ba0-96db-60bfd816232e tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf" status: 200 len: 1740 microversion: 2.20 time: 0.171158 May 19 21:36:47.945896 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 271/533] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:36:47 2022] GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf => generated 1740 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:36:48.172527 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-a2c220a4-d607-4b6e-b837-3d73b8c4802b tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:36:48.173099 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-a2c220a4-d607-4b6e-b837-3d73b8c4802b tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] [instance: a392a14d-152c-467f-8031-a4bb8e36e5bb] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:36:48.180141 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a2c220a4-d607-4b6e-b837-3d73b8c4802b tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:48.180588 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a2c220a4-d607-4b6e-b837-3d73b8c4802b tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:48.181320 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a2c220a4-d607-4b6e-b837-3d73b8c4802b tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:48.181841 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a2c220a4-d607-4b6e-b837-3d73b8c4802b tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:48.320302 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-a2c220a4-d607-4b6e-b837-3d73b8c4802b tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d16feb169ac46f7983a6b8045de77c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f5916770e9b443489fe7aa76d663fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:48.329094 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-a2c220a4-d607-4b6e-b837-3d73b8c4802b tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] 10.222.0.65 "GET /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb" status: 200 len: 1723 microversion: 2.1 time: 0.160460 May 19 21:36:48.329664 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 263/534] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:36:48 2022] GET /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:36:48.964852 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-3e5a4e75-8e09-4b2b-bb35-6f546b45b1e1 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:36:48.965797 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-3e5a4e75-8e09-4b2b-bb35-6f546b45b1e1 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: e0250d7d-3766-4555-a9af-2429afad53bf] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:36:48.975546 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3e5a4e75-8e09-4b2b-bb35-6f546b45b1e1 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:48.976160 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3e5a4e75-8e09-4b2b-bb35-6f546b45b1e1 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:48.976942 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3e5a4e75-8e09-4b2b-bb35-6f546b45b1e1 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:48.977366 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3e5a4e75-8e09-4b2b-bb35-6f546b45b1e1 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:49.118841 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-3e5a4e75-8e09-4b2b-bb35-6f546b45b1e1 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:49.127469 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-3e5a4e75-8e09-4b2b-bb35-6f546b45b1e1 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:49.128940 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-3e5a4e75-8e09-4b2b-bb35-6f546b45b1e1 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:49.130082 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-3e5a4e75-8e09-4b2b-bb35-6f546b45b1e1 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf" status: 200 len: 1740 microversion: 2.20 time: 0.170397 May 19 21:36:49.130669 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 272/535] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:36:48 2022] GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf => generated 1740 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:36:49.347682 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-a5b751b5-a038-4ec9-9191-dca7a1b29c76 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:36:49.348279 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-a5b751b5-a038-4ec9-9191-dca7a1b29c76 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] [instance: a392a14d-152c-467f-8031-a4bb8e36e5bb] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:36:49.355581 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a5b751b5-a038-4ec9-9191-dca7a1b29c76 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:49.356014 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a5b751b5-a038-4ec9-9191-dca7a1b29c76 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:49.356781 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a5b751b5-a038-4ec9-9191-dca7a1b29c76 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:49.357211 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a5b751b5-a038-4ec9-9191-dca7a1b29c76 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:49.498999 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-a5b751b5-a038-4ec9-9191-dca7a1b29c76 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d16feb169ac46f7983a6b8045de77c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f5916770e9b443489fe7aa76d663fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:49.507395 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-a5b751b5-a038-4ec9-9191-dca7a1b29c76 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] 10.222.0.65 "GET /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb" status: 200 len: 1700 microversion: 2.1 time: 0.163540 May 19 21:36:49.508032 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 264/536] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:36:49 2022] GET /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb => generated 1700 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:36:49.529210 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-d2ef6bce-6b21-48ba-83b7-e227cae8fb4e tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:36:49.536682 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d2ef6bce-6b21-48ba-83b7-e227cae8fb4e tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:49.537158 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d2ef6bce-6b21-48ba-83b7-e227cae8fb4e tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:49.601771 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-d2ef6bce-6b21-48ba-83b7-e227cae8fb4e tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] [instance: a392a14d-152c-467f-8031-a4bb8e36e5bb] Going to try to start instance {{(pid=124350) start /opt/stack/nova/nova/compute/api.py:2730}} May 19 21:36:49.648078 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-d2ef6bce-6b21-48ba-83b7-e227cae8fb4e tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] 10.222.0.65 "POST /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb/action" status: 202 len: 0 microversion: 2.1 time: 0.123544 May 19 21:36:49.652650 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 273/537] 10.222.0.65 () {60 vars in 1277 bytes} [Thu May 19 21:36:49 2022] POST /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 21:36:49.662735 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-bb5ed528-1fc9-4e56-8340-38bddcce9efa tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:36:49.663788 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-bb5ed528-1fc9-4e56-8340-38bddcce9efa tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] [instance: a392a14d-152c-467f-8031-a4bb8e36e5bb] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:36:49.673690 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-bb5ed528-1fc9-4e56-8340-38bddcce9efa tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:49.674430 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-bb5ed528-1fc9-4e56-8340-38bddcce9efa tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:49.675787 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-bb5ed528-1fc9-4e56-8340-38bddcce9efa tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:49.676509 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-bb5ed528-1fc9-4e56-8340-38bddcce9efa tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:49.850123 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-bb5ed528-1fc9-4e56-8340-38bddcce9efa tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d16feb169ac46f7983a6b8045de77c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f5916770e9b443489fe7aa76d663fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:49.862919 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-bb5ed528-1fc9-4e56-8340-38bddcce9efa tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] 10.222.0.65 "GET /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb" status: 200 len: 1709 microversion: 2.1 time: 0.208788 May 19 21:36:49.863501 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 265/538] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:36:49 2022] GET /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb => generated 1709 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:36:50.150863 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-9b5e4cef-1c2b-4f7f-b6c1-7c31adcb94ca tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:36:50.151481 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-9b5e4cef-1c2b-4f7f-b6c1-7c31adcb94ca tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: e0250d7d-3766-4555-a9af-2429afad53bf] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:36:50.158142 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9b5e4cef-1c2b-4f7f-b6c1-7c31adcb94ca tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:50.158708 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9b5e4cef-1c2b-4f7f-b6c1-7c31adcb94ca tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:50.159481 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9b5e4cef-1c2b-4f7f-b6c1-7c31adcb94ca tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:50.159908 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9b5e4cef-1c2b-4f7f-b6c1-7c31adcb94ca tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:50.312960 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-9b5e4cef-1c2b-4f7f-b6c1-7c31adcb94ca tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:50.325311 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-9b5e4cef-1c2b-4f7f-b6c1-7c31adcb94ca tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:50.326845 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-9b5e4cef-1c2b-4f7f-b6c1-7c31adcb94ca tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:50.327998 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-9b5e4cef-1c2b-4f7f-b6c1-7c31adcb94ca tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf" status: 200 len: 1740 microversion: 2.20 time: 0.182405 May 19 21:36:50.328556 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 274/539] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:36:50 2022] GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf => generated 1740 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:36:50.880589 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-adf02081-d731-41c5-a2cf-98d25052ca9f tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:36:50.881139 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-adf02081-d731-41c5-a2cf-98d25052ca9f tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] [instance: a392a14d-152c-467f-8031-a4bb8e36e5bb] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:36:50.888315 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-adf02081-d731-41c5-a2cf-98d25052ca9f tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:50.888759 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-adf02081-d731-41c5-a2cf-98d25052ca9f tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:50.889509 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-adf02081-d731-41c5-a2cf-98d25052ca9f tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:50.889934 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-adf02081-d731-41c5-a2cf-98d25052ca9f tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:51.034186 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-adf02081-d731-41c5-a2cf-98d25052ca9f tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d16feb169ac46f7983a6b8045de77c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f5916770e9b443489fe7aa76d663fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:51.042849 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-adf02081-d731-41c5-a2cf-98d25052ca9f tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] 10.222.0.65 "GET /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb" status: 200 len: 1709 microversion: 2.1 time: 0.166101 May 19 21:36:51.043420 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 266/540] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:36:50 2022] GET /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb => generated 1709 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:36:51.353422 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-8dc4d770-6d1b-4846-a474-d27d533aff05 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:36:51.354007 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-8dc4d770-6d1b-4846-a474-d27d533aff05 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: e0250d7d-3766-4555-a9af-2429afad53bf] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:36:51.361088 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8dc4d770-6d1b-4846-a474-d27d533aff05 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:51.361528 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8dc4d770-6d1b-4846-a474-d27d533aff05 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:51.362283 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8dc4d770-6d1b-4846-a474-d27d533aff05 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:51.362734 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8dc4d770-6d1b-4846-a474-d27d533aff05 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:51.512408 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-8dc4d770-6d1b-4846-a474-d27d533aff05 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:51.520869 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-8dc4d770-6d1b-4846-a474-d27d533aff05 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:51.522344 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-8dc4d770-6d1b-4846-a474-d27d533aff05 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:51.523514 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-8dc4d770-6d1b-4846-a474-d27d533aff05 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf" status: 200 len: 1740 microversion: 2.20 time: 0.174128 May 19 21:36:51.524071 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 275/541] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:36:51 2022] GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf => generated 1740 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:36:52.061169 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-a46c5645-787e-4c0f-8284-13c48f98ea74 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:36:52.061727 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-a46c5645-787e-4c0f-8284-13c48f98ea74 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] [instance: a392a14d-152c-467f-8031-a4bb8e36e5bb] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:36:52.068589 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a46c5645-787e-4c0f-8284-13c48f98ea74 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:52.069032 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a46c5645-787e-4c0f-8284-13c48f98ea74 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:52.069806 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a46c5645-787e-4c0f-8284-13c48f98ea74 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:52.070285 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a46c5645-787e-4c0f-8284-13c48f98ea74 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:52.212985 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-a46c5645-787e-4c0f-8284-13c48f98ea74 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d16feb169ac46f7983a6b8045de77c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f5916770e9b443489fe7aa76d663fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:52.221143 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-a46c5645-787e-4c0f-8284-13c48f98ea74 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] 10.222.0.65 "GET /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb" status: 200 len: 1709 microversion: 2.1 time: 0.164221 May 19 21:36:52.221712 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 267/542] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:36:52 2022] GET /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb => generated 1709 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:36:52.544106 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-680c4260-43ca-452e-9afb-fc72f546d556 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:36:52.544714 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-680c4260-43ca-452e-9afb-fc72f546d556 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: e0250d7d-3766-4555-a9af-2429afad53bf] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:36:52.551575 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-680c4260-43ca-452e-9afb-fc72f546d556 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:52.551999 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-680c4260-43ca-452e-9afb-fc72f546d556 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:52.552767 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-680c4260-43ca-452e-9afb-fc72f546d556 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:52.553192 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-680c4260-43ca-452e-9afb-fc72f546d556 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:52.694975 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-680c4260-43ca-452e-9afb-fc72f546d556 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:52.703892 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-680c4260-43ca-452e-9afb-fc72f546d556 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:52.705390 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-680c4260-43ca-452e-9afb-fc72f546d556 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:52.706571 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-680c4260-43ca-452e-9afb-fc72f546d556 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf" status: 200 len: 1722 microversion: 2.20 time: 0.166945 May 19 21:36:52.707120 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 276/543] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:36:52 2022] GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:36:53.237849 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-044b1a81-57d3-4cf9-b3e8-6d066ad02535 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:36:53.238417 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-044b1a81-57d3-4cf9-b3e8-6d066ad02535 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] [instance: a392a14d-152c-467f-8031-a4bb8e36e5bb] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:36:53.245617 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-044b1a81-57d3-4cf9-b3e8-6d066ad02535 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:53.246059 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-044b1a81-57d3-4cf9-b3e8-6d066ad02535 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:53.246844 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-044b1a81-57d3-4cf9-b3e8-6d066ad02535 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:53.247275 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-044b1a81-57d3-4cf9-b3e8-6d066ad02535 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:53.249879 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_cell1:SELECT=100 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:36:53.391581 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-044b1a81-57d3-4cf9-b3e8-6d066ad02535 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d16feb169ac46f7983a6b8045de77c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f5916770e9b443489fe7aa76d663fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:53.399984 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-044b1a81-57d3-4cf9-b3e8-6d066ad02535 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] 10.222.0.65 "GET /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb" status: 200 len: 1709 microversion: 2.1 time: 0.166161 May 19 21:36:53.400819 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 268/544] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:36:53 2022] GET /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb => generated 1709 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:36:53.729841 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-8e67238e-e092-45bd-8e9a-85d40c2ca42c tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:36:53.730533 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-8e67238e-e092-45bd-8e9a-85d40c2ca42c tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: e0250d7d-3766-4555-a9af-2429afad53bf] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:36:53.737394 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8e67238e-e092-45bd-8e9a-85d40c2ca42c tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:53.737838 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8e67238e-e092-45bd-8e9a-85d40c2ca42c tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:53.738628 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8e67238e-e092-45bd-8e9a-85d40c2ca42c tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:53.739053 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8e67238e-e092-45bd-8e9a-85d40c2ca42c tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:53.883162 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-8e67238e-e092-45bd-8e9a-85d40c2ca42c tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:53.892731 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-8e67238e-e092-45bd-8e9a-85d40c2ca42c tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:53.894220 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-8e67238e-e092-45bd-8e9a-85d40c2ca42c tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:53.895410 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-8e67238e-e092-45bd-8e9a-85d40c2ca42c tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf" status: 200 len: 1722 microversion: 2.20 time: 0.170038 May 19 21:36:53.895973 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 277/545] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:36:53 2022] GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:36:54.421277 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-f3c7339f-864e-4c6b-b03c-5f36119a9ab7 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:36:54.421895 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-f3c7339f-864e-4c6b-b03c-5f36119a9ab7 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] [instance: a392a14d-152c-467f-8031-a4bb8e36e5bb] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:36:54.430876 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f3c7339f-864e-4c6b-b03c-5f36119a9ab7 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:54.431558 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f3c7339f-864e-4c6b-b03c-5f36119a9ab7 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:54.432340 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f3c7339f-864e-4c6b-b03c-5f36119a9ab7 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:54.432782 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f3c7339f-864e-4c6b-b03c-5f36119a9ab7 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:54.575322 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-f3c7339f-864e-4c6b-b03c-5f36119a9ab7 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d16feb169ac46f7983a6b8045de77c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f5916770e9b443489fe7aa76d663fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:54.583671 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-f3c7339f-864e-4c6b-b03c-5f36119a9ab7 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] 10.222.0.65 "GET /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb" status: 200 len: 1709 microversion: 2.1 time: 0.166251 May 19 21:36:54.584226 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 269/546] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:36:54 2022] GET /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb => generated 1709 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:36:54.684656 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [req-b1d6c5d8-5de5-4b68-b0a1-c039fb26f112 req-0f3c4dd8-98f8-494a-887c-23e77700fc30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0250d7d-3766-4555-a9af-2429afad53bf", "name": "network-vif-unplugged", "status": "completed", "tag": "7fe0112e-1449-4e73-9fa1-f6d3a33168d8"}]} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:36:54.695983 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-b1d6c5d8-5de5-4b68-b0a1-c039fb26f112 req-0f3c4dd8-98f8-494a-887c-23e77700fc30 service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:54.696681 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-b1d6c5d8-5de5-4b68-b0a1-c039fb26f112 req-0f3c4dd8-98f8-494a-887c-23e77700fc30 service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:54.720051 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.compute.server_external_events [req-b1d6c5d8-5de5-4b68-b0a1-c039fb26f112 req-0f3c4dd8-98f8-494a-887c-23e77700fc30 service nova] Creating event network-vif-unplugged:7fe0112e-1449-4e73-9fa1-f6d3a33168d8 for instance e0250d7d-3766-4555-a9af-2429afad53bf on hv-cinder-83563 May 19 21:36:54.727828 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [req-b1d6c5d8-5de5-4b68-b0a1-c039fb26f112 req-0f3c4dd8-98f8-494a-887c-23e77700fc30 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047629 May 19 21:36:54.729460 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 278/547] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 21:36:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 21:36:54.914262 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-18967488-dcca-4dff-8a0c-af821f950393 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:36:54.914892 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-18967488-dcca-4dff-8a0c-af821f950393 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: e0250d7d-3766-4555-a9af-2429afad53bf] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:36:54.921898 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-18967488-dcca-4dff-8a0c-af821f950393 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:54.922376 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-18967488-dcca-4dff-8a0c-af821f950393 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:54.923227 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-18967488-dcca-4dff-8a0c-af821f950393 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:54.923673 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-18967488-dcca-4dff-8a0c-af821f950393 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:55.148749 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-18967488-dcca-4dff-8a0c-af821f950393 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:55.160853 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-18967488-dcca-4dff-8a0c-af821f950393 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:55.162461 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-18967488-dcca-4dff-8a0c-af821f950393 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:55.163762 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-18967488-dcca-4dff-8a0c-af821f950393 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf" status: 200 len: 1722 microversion: 2.20 time: 0.253611 May 19 21:36:55.164332 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 270/548] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:36:54 2022] GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf => generated 1722 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:36:55.603288 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-5951ffff-f626-4f0e-b901-345a1f5482a0 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:36:55.604053 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-5951ffff-f626-4f0e-b901-345a1f5482a0 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] [instance: a392a14d-152c-467f-8031-a4bb8e36e5bb] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:36:55.613689 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5951ffff-f626-4f0e-b901-345a1f5482a0 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:55.614141 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5951ffff-f626-4f0e-b901-345a1f5482a0 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:55.615075 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5951ffff-f626-4f0e-b901-345a1f5482a0 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:55.615540 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5951ffff-f626-4f0e-b901-345a1f5482a0 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:55.758489 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-5951ffff-f626-4f0e-b901-345a1f5482a0 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d16feb169ac46f7983a6b8045de77c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f5916770e9b443489fe7aa76d663fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:55.767360 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-5951ffff-f626-4f0e-b901-345a1f5482a0 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] 10.222.0.65 "GET /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb" status: 200 len: 1709 microversion: 2.1 time: 0.169002 May 19 21:36:55.767945 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 279/549] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:36:55 2022] GET /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb => generated 1709 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:36:56.193297 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-954238e7-0ce3-455a-aaea-04e43dcf7390 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:36:56.193866 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-954238e7-0ce3-455a-aaea-04e43dcf7390 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: e0250d7d-3766-4555-a9af-2429afad53bf] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:36:56.201442 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-954238e7-0ce3-455a-aaea-04e43dcf7390 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:56.201882 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-954238e7-0ce3-455a-aaea-04e43dcf7390 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:56.202744 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-954238e7-0ce3-455a-aaea-04e43dcf7390 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:56.203210 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-954238e7-0ce3-455a-aaea-04e43dcf7390 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:56.357494 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-954238e7-0ce3-455a-aaea-04e43dcf7390 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:56.366070 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-954238e7-0ce3-455a-aaea-04e43dcf7390 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:56.367577 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-954238e7-0ce3-455a-aaea-04e43dcf7390 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:56.368917 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-954238e7-0ce3-455a-aaea-04e43dcf7390 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf" status: 200 len: 1722 microversion: 2.20 time: 0.179851 May 19 21:36:56.369736 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 271/550] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:36:56 2022] GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf => generated 1722 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:36:56.789319 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-15542270-39c0-470d-ac6b-99752f1ee798 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:36:56.789930 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-15542270-39c0-470d-ac6b-99752f1ee798 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] [instance: a392a14d-152c-467f-8031-a4bb8e36e5bb] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:36:56.797144 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-15542270-39c0-470d-ac6b-99752f1ee798 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:56.797582 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-15542270-39c0-470d-ac6b-99752f1ee798 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:56.798498 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-15542270-39c0-470d-ac6b-99752f1ee798 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:56.798928 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-15542270-39c0-470d-ac6b-99752f1ee798 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:56.933947 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-15542270-39c0-470d-ac6b-99752f1ee798 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d16feb169ac46f7983a6b8045de77c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f5916770e9b443489fe7aa76d663fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:56.945716 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-15542270-39c0-470d-ac6b-99752f1ee798 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] 10.222.0.65 "GET /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb" status: 200 len: 1709 microversion: 2.1 time: 0.160187 May 19 21:36:56.946396 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 280/551] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:36:56 2022] GET /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb => generated 1709 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:36:57.388442 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-82e6ee2c-2019-4ee5-af39-ff5a3fa27aa2 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:36:57.389157 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-82e6ee2c-2019-4ee5-af39-ff5a3fa27aa2 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: e0250d7d-3766-4555-a9af-2429afad53bf] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:36:57.396193 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-82e6ee2c-2019-4ee5-af39-ff5a3fa27aa2 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:57.396699 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-82e6ee2c-2019-4ee5-af39-ff5a3fa27aa2 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:57.397561 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-82e6ee2c-2019-4ee5-af39-ff5a3fa27aa2 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:57.397993 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-82e6ee2c-2019-4ee5-af39-ff5a3fa27aa2 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:57.548858 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-82e6ee2c-2019-4ee5-af39-ff5a3fa27aa2 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:57.557908 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-82e6ee2c-2019-4ee5-af39-ff5a3fa27aa2 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:57.559520 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-82e6ee2c-2019-4ee5-af39-ff5a3fa27aa2 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:57.560841 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-82e6ee2c-2019-4ee5-af39-ff5a3fa27aa2 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf" status: 200 len: 1722 microversion: 2.20 time: 0.176648 May 19 21:36:57.561393 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 272/552] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:36:57 2022] GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf => generated 1722 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:36:57.963824 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-edb6e470-05e8-40c0-9683-a1f95d5e42f4 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:36:57.964608 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-edb6e470-05e8-40c0-9683-a1f95d5e42f4 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] [instance: a392a14d-152c-467f-8031-a4bb8e36e5bb] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:36:57.974754 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-edb6e470-05e8-40c0-9683-a1f95d5e42f4 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:57.975368 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-edb6e470-05e8-40c0-9683-a1f95d5e42f4 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:57.976308 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-edb6e470-05e8-40c0-9683-a1f95d5e42f4 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:57.977874 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-edb6e470-05e8-40c0-9683-a1f95d5e42f4 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:57.995464 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:36:58.121577 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-edb6e470-05e8-40c0-9683-a1f95d5e42f4 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d16feb169ac46f7983a6b8045de77c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f5916770e9b443489fe7aa76d663fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:58.129825 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-edb6e470-05e8-40c0-9683-a1f95d5e42f4 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] 10.222.0.65 "GET /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb" status: 200 len: 1713 microversion: 2.1 time: 0.170477 May 19 21:36:58.130408 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 281/553] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:36:57 2022] GET /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb => generated 1713 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:36:58.581893 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-28dd2b3c-435b-4e9b-b017-67b1aa74e760 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:36:58.582517 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-28dd2b3c-435b-4e9b-b017-67b1aa74e760 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: e0250d7d-3766-4555-a9af-2429afad53bf] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:36:58.592968 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-28dd2b3c-435b-4e9b-b017-67b1aa74e760 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:58.593684 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-28dd2b3c-435b-4e9b-b017-67b1aa74e760 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:58.594599 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-28dd2b3c-435b-4e9b-b017-67b1aa74e760 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:58.595305 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-28dd2b3c-435b-4e9b-b017-67b1aa74e760 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:58.990786 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-28dd2b3c-435b-4e9b-b017-67b1aa74e760 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:58.999609 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-28dd2b3c-435b-4e9b-b017-67b1aa74e760 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:59.001089 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-28dd2b3c-435b-4e9b-b017-67b1aa74e760 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:59.002262 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-28dd2b3c-435b-4e9b-b017-67b1aa74e760 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf" status: 200 len: 1665 microversion: 2.20 time: 0.425713 May 19 21:36:59.002927 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 273/554] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:36:58 2022] GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf => generated 1665 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:36:59.020678 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-673499cb-b91d-4e5b-bd3c-706a72b27ddb tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "26cb0e21-2aa9-48a8-93d7-9d55730a71a6"}} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:36:59.021720 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-673499cb-b91d-4e5b-bd3c-706a72b27ddb tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: e0250d7d-3766-4555-a9af-2429afad53bf] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:36:59.028668 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-673499cb-b91d-4e5b-bd3c-706a72b27ddb tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:59.029121 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-673499cb-b91d-4e5b-bd3c-706a72b27ddb tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:59.029889 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-673499cb-b91d-4e5b-bd3c-706a72b27ddb tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:59.030345 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-673499cb-b91d-4e5b-bd3c-706a72b27ddb tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:59.327874 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-683ebe3c-e5ca-4107-8a38-9f8a03a067db tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:36:59.328356 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-683ebe3c-e5ca-4107-8a38-9f8a03a067db tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] [instance: 8b820379-bb78-465a-a84d-7c1e945c74da] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:36:59.335772 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-683ebe3c-e5ca-4107-8a38-9f8a03a067db tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:59.336691 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-683ebe3c-e5ca-4107-8a38-9f8a03a067db tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:59.337523 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-683ebe3c-e5ca-4107-8a38-9f8a03a067db tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:59.338258 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-683ebe3c-e5ca-4107-8a38-9f8a03a067db tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:59.360588 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-673499cb-b91d-4e5b-bd3c-706a72b27ddb tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "POST /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.343954 May 19 21:36:59.361214 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 282/555] 10.222.0.65 () {62 vars in 1363 bytes} [Thu May 19 21:36:59 2022] POST /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf/os-volume_attachments => generated 188 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 21:36:59.471333 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.objects.instance [None req-683ebe3c-e5ca-4107-8a38-9f8a03a067db tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lazy-loading 'services' on Instance uuid 8b820379-bb78-465a-a84d-7c1e945c74da {{(pid=124349) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 21:36:59.481666 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-3a9b607c-fe2b-4dcf-a3e7-2207912c6c54 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:36:59.482227 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-3a9b607c-fe2b-4dcf-a3e7-2207912c6c54 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: e0250d7d-3766-4555-a9af-2429afad53bf] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:36:59.489184 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3a9b607c-fe2b-4dcf-a3e7-2207912c6c54 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:59.489603 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3a9b607c-fe2b-4dcf-a3e7-2207912c6c54 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:59.490572 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3a9b607c-fe2b-4dcf-a3e7-2207912c6c54 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:59.491008 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3a9b607c-fe2b-4dcf-a3e7-2207912c6c54 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:59.586818 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-683ebe3c-e5ca-4107-8a38-9f8a03a067db tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] 10.222.0.65 "DELETE /compute/v2.1/servers/8b820379-bb78-465a-a84d-7c1e945c74da/os-volume_attachments/6f2e80e3-f6aa-4301-8f4e-249305e3516a" status: 202 len: 0 microversion: 2.1 time: 0.262382 May 19 21:36:59.587722 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 274/556] 10.222.0.65 () {58 vars in 1415 bytes} [Thu May 19 21:36:59 2022] DELETE /compute/v2.1/servers/8b820379-bb78-465a-a84d-7c1e945c74da/os-volume_attachments/6f2e80e3-f6aa-4301-8f4e-249305e3516a => generated 0 bytes in 264 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 21:36:59.587880 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-3a9b607c-fe2b-4dcf-a3e7-2207912c6c54 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "POST /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf/action" status: 202 len: 0 microversion: 2.20 time: 0.110365 May 19 21:36:59.592058 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 283/557] 10.222.0.65 () {62 vars in 1318 bytes} [Thu May 19 21:36:59 2022] POST /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 19 21:36:59.599479 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-a7ebac14-4b7a-474a-b60f-7221ce166b52 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:36:59.600185 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-a7ebac14-4b7a-474a-b60f-7221ce166b52 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: e0250d7d-3766-4555-a9af-2429afad53bf] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:36:59.607907 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a7ebac14-4b7a-474a-b60f-7221ce166b52 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:59.608549 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a7ebac14-4b7a-474a-b60f-7221ce166b52 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:59.609335 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a7ebac14-4b7a-474a-b60f-7221ce166b52 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:36:59.609782 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a7ebac14-4b7a-474a-b60f-7221ce166b52 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:36:59.764019 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-a7ebac14-4b7a-474a-b60f-7221ce166b52 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:59.772463 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-a7ebac14-4b7a-474a-b60f-7221ce166b52 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:59.773953 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-a7ebac14-4b7a-474a-b60f-7221ce166b52 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:36:59.775219 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-a7ebac14-4b7a-474a-b60f-7221ce166b52 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf" status: 200 len: 1751 microversion: 2.20 time: 0.180208 May 19 21:36:59.776453 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 275/558] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:36:59 2022] GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf => generated 1751 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:37:00.730447 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-f524878a-9cb4-4060-9a08-26f1cb8189af tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:37:00.731187 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-f524878a-9cb4-4060-9a08-26f1cb8189af tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] [instance: 8b820379-bb78-465a-a84d-7c1e945c74da] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:37:00.738024 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f524878a-9cb4-4060-9a08-26f1cb8189af tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:37:00.738507 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f524878a-9cb4-4060-9a08-26f1cb8189af tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:37:00.739246 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f524878a-9cb4-4060-9a08-26f1cb8189af tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:37:00.739668 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f524878a-9cb4-4060-9a08-26f1cb8189af tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:37:00.768314 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-f524878a-9cb4-4060-9a08-26f1cb8189af tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] [instance: 8b820379-bb78-465a-a84d-7c1e945c74da] Going to try to terminate instance {{(pid=124350) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 21:37:00.793931 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-a0f21b13-72f0-403f-bd29-55cd1da025d0 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:37:00.794562 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-a0f21b13-72f0-403f-bd29-55cd1da025d0 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: e0250d7d-3766-4555-a9af-2429afad53bf] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:37:00.801321 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a0f21b13-72f0-403f-bd29-55cd1da025d0 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:37:00.801789 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a0f21b13-72f0-403f-bd29-55cd1da025d0 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:37:00.802665 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a0f21b13-72f0-403f-bd29-55cd1da025d0 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:37:00.803405 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a0f21b13-72f0-403f-bd29-55cd1da025d0 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:37:00.854742 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-f524878a-9cb4-4060-9a08-26f1cb8189af tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] 10.222.0.65 "DELETE /compute/v2.1/servers/8b820379-bb78-465a-a84d-7c1e945c74da" status: 204 len: 0 microversion: 2.1 time: 0.128994 May 19 21:37:00.856051 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 284/559] 10.222.0.65 () {58 vars in 1238 bytes} [Thu May 19 21:37:00 2022] DELETE /compute/v2.1/servers/8b820379-bb78-465a-a84d-7c1e945c74da => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 21:37:00.869638 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-1d16936d-5577-4391-896b-4db38e4d06be tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:37:00.870688 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-1d16936d-5577-4391-896b-4db38e4d06be tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] [instance: 8b820379-bb78-465a-a84d-7c1e945c74da] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:37:00.878904 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1d16936d-5577-4391-896b-4db38e4d06be tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:37:00.879363 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1d16936d-5577-4391-896b-4db38e4d06be tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:37:00.880315 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1d16936d-5577-4391-896b-4db38e4d06be tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:37:00.880736 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1d16936d-5577-4391-896b-4db38e4d06be tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:37:00.960287 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-a0f21b13-72f0-403f-bd29-55cd1da025d0 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:37:00.969382 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-a0f21b13-72f0-403f-bd29-55cd1da025d0 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:37:00.970900 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-a0f21b13-72f0-403f-bd29-55cd1da025d0 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:37:00.972043 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-a0f21b13-72f0-403f-bd29-55cd1da025d0 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf" status: 200 len: 1753 microversion: 2.20 time: 0.182294 May 19 21:37:00.972596 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 276/560] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:37:00 2022] GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf => generated 1753 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:37:01.014702 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-1d16936d-5577-4391-896b-4db38e4d06be tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ad8b76baf294f91bc4c641280ab03f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '120a6c484bec4e52bc5891c927647e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:37:01.024152 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-1d16936d-5577-4391-896b-4db38e4d06be tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] 10.222.0.65 "GET /compute/v2.1/servers/8b820379-bb78-465a-a84d-7c1e945c74da" status: 200 len: 1513 microversion: 2.1 time: 0.160393 May 19 21:37:01.024761 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 285/561] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:37:00 2022] GET /compute/v2.1/servers/8b820379-bb78-465a-a84d-7c1e945c74da => generated 1513 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:37:01.991149 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-eff033a0-eaa0-4f2d-9d8b-c76a7f8f47b3 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:37:01.991713 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-eff033a0-eaa0-4f2d-9d8b-c76a7f8f47b3 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: e0250d7d-3766-4555-a9af-2429afad53bf] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:37:01.998750 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-eff033a0-eaa0-4f2d-9d8b-c76a7f8f47b3 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:37:01.999196 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-eff033a0-eaa0-4f2d-9d8b-c76a7f8f47b3 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:37:01.999954 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-eff033a0-eaa0-4f2d-9d8b-c76a7f8f47b3 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:37:02.000376 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-eff033a0-eaa0-4f2d-9d8b-c76a7f8f47b3 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:37:02.041063 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-31e4c848-4995-44a3-ac48-3252806f4871 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:37:02.042258 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-31e4c848-4995-44a3-ac48-3252806f4871 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] [instance: 8b820379-bb78-465a-a84d-7c1e945c74da] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:37:02.049259 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-31e4c848-4995-44a3-ac48-3252806f4871 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:37:02.049677 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-31e4c848-4995-44a3-ac48-3252806f4871 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:37:02.050541 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-31e4c848-4995-44a3-ac48-3252806f4871 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:37:02.050971 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-31e4c848-4995-44a3-ac48-3252806f4871 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:37:02.138484 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-eff033a0-eaa0-4f2d-9d8b-c76a7f8f47b3 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:37:02.147283 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-eff033a0-eaa0-4f2d-9d8b-c76a7f8f47b3 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:37:02.148781 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-eff033a0-eaa0-4f2d-9d8b-c76a7f8f47b3 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:37:02.149931 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-eff033a0-eaa0-4f2d-9d8b-c76a7f8f47b3 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf" status: 200 len: 1753 microversion: 2.20 time: 0.162822 May 19 21:37:02.150588 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 277/562] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:37:01 2022] GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf => generated 1753 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:37:02.195349 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-31e4c848-4995-44a3-ac48-3252806f4871 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ad8b76baf294f91bc4c641280ab03f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '120a6c484bec4e52bc5891c927647e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:37:02.203791 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-31e4c848-4995-44a3-ac48-3252806f4871 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] 10.222.0.65 "GET /compute/v2.1/servers/8b820379-bb78-465a-a84d-7c1e945c74da" status: 200 len: 1513 microversion: 2.1 time: 0.166505 May 19 21:37:02.204371 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 286/563] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:37:02 2022] GET /compute/v2.1/servers/8b820379-bb78-465a-a84d-7c1e945c74da => generated 1513 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:37:03.170216 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-a5517647-d857-4e9d-94c0-b5682505ce78 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:37:03.170858 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-a5517647-d857-4e9d-94c0-b5682505ce78 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: e0250d7d-3766-4555-a9af-2429afad53bf] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:37:03.178053 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a5517647-d857-4e9d-94c0-b5682505ce78 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:37:03.178534 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a5517647-d857-4e9d-94c0-b5682505ce78 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:37:03.179307 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a5517647-d857-4e9d-94c0-b5682505ce78 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:37:03.179934 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a5517647-d857-4e9d-94c0-b5682505ce78 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:37:03.220921 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-25fbc8cd-63f2-4565-b154-0661a4bb592b tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:37:03.222266 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-25fbc8cd-63f2-4565-b154-0661a4bb592b tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] [instance: 8b820379-bb78-465a-a84d-7c1e945c74da] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:37:03.229301 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-25fbc8cd-63f2-4565-b154-0661a4bb592b tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:37:03.229993 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-25fbc8cd-63f2-4565-b154-0661a4bb592b tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:37:03.233199 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-25fbc8cd-63f2-4565-b154-0661a4bb592b tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:37:03.233736 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-25fbc8cd-63f2-4565-b154-0661a4bb592b tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:37:03.375725 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-25fbc8cd-63f2-4565-b154-0661a4bb592b tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ad8b76baf294f91bc4c641280ab03f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '120a6c484bec4e52bc5891c927647e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:37:03.383759 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-25fbc8cd-63f2-4565-b154-0661a4bb592b tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] 10.222.0.65 "GET /compute/v2.1/servers/8b820379-bb78-465a-a84d-7c1e945c74da" status: 200 len: 1513 microversion: 2.1 time: 0.166498 May 19 21:37:03.384309 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 287/564] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:37:03 2022] GET /compute/v2.1/servers/8b820379-bb78-465a-a84d-7c1e945c74da => generated 1513 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 21:37:03.396831 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-a5517647-d857-4e9d-94c0-b5682505ce78 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:37:03.417068 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-a5517647-d857-4e9d-94c0-b5682505ce78 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:37:03.418186 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-a5517647-d857-4e9d-94c0-b5682505ce78 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:37:03.419511 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-a5517647-d857-4e9d-94c0-b5682505ce78 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf" status: 200 len: 1809 microversion: 2.20 time: 0.254250 May 19 21:37:03.420136 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 278/565] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:37:03 2022] GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf => generated 1809 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:37:03.584509 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [req-bb664fe7-ea96-4d19-8cc3-fafe581b96e7 req-d8c3bf03-fd99-447d-9e1a-f84f937b46e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b820379-bb78-465a-a84d-7c1e945c74da", "name": "network-vif-deleted", "tag": "ac2da9c6-dba5-4638-b63a-d637577ccb4a"}]} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:37:03.594691 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-bb664fe7-ea96-4d19-8cc3-fafe581b96e7 req-d8c3bf03-fd99-447d-9e1a-f84f937b46e2 service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:37:03.595215 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-bb664fe7-ea96-4d19-8cc3-fafe581b96e7 req-d8c3bf03-fd99-447d-9e1a-f84f937b46e2 service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:37:03.607407 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.compute.server_external_events [req-bb664fe7-ea96-4d19-8cc3-fafe581b96e7 req-d8c3bf03-fd99-447d-9e1a-f84f937b46e2 service nova] Creating event network-vif-deleted:ac2da9c6-dba5-4638-b63a-d637577ccb4a for instance 8b820379-bb78-465a-a84d-7c1e945c74da on hv-cinder-83563 May 19 21:37:03.613688 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [req-bb664fe7-ea96-4d19-8cc3-fafe581b96e7 req-d8c3bf03-fd99-447d-9e1a-f84f937b46e2 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032932 May 19 21:37:03.614874 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 288/566] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 21:37:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 21:37:04.401765 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-1a309035-b315-48b1-8e4a-1a047813eebc tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:37:04.402432 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-1a309035-b315-48b1-8e4a-1a047813eebc tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] [instance: 8b820379-bb78-465a-a84d-7c1e945c74da] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:37:04.409921 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1a309035-b315-48b1-8e4a-1a047813eebc tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:37:04.410392 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1a309035-b315-48b1-8e4a-1a047813eebc tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:37:04.411159 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1a309035-b315-48b1-8e4a-1a047813eebc tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:37:04.411590 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1a309035-b315-48b1-8e4a-1a047813eebc tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:37:04.425248 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.wsgi [None req-1a309035-b315-48b1-8e4a-1a047813eebc tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] HTTP exception thrown: Instance 8b820379-bb78-465a-a84d-7c1e945c74da could not be found. May 19 21:37:04.426967 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-1a309035-b315-48b1-8e4a-1a047813eebc tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Request method failure captured: May 19 21:37:04.426967 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: request: GET /compute/v2.1/servers/8b820379-bb78-465a-a84d-7c1e945c74da HTTP/1.1 May 19 21:37:04.426967 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Accept: application/json May 19 21:37:04.426967 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Accept-Encoding: identity May 19 21:37:04.426967 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Connection: close May 19 21:37:04.426967 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Content-Length: 0 May 19 21:37:04.426967 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Content-Type: application/json May 19 21:37:04.426967 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Host: 10.222.0.65 May 19 21:37:04.426967 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Openstack-System-Scope: None May 19 21:37:04.426967 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: User-Agent: python-urllib3/1.26.9 May 19 21:37:04.426967 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Auth-Token: gAAAAABihrgYquI9FZstsnfBTMisWYHpd3CQ4zYcWPhDIWZ4cBrM0Qo--ryZwxUU7lVO9zuUybYw-PytYrSaUvcceMvCEkcf9_FQkhPLykut92xflEhCVHIwsaebDxQ4j1Y5WLAr3qXPOuLW1twA3SYQfIZFvQe3HLvDRYoEvuKq35E5EmDskT8 May 19 21:37:04.426967 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Domain-Id: None May 19 21:37:04.426967 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Domain-Name: None May 19 21:37:04.426967 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Identity-Status: Confirmed May 19 21:37:04.426967 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Is-Admin-Project: True May 19 21:37:04.426967 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Project-Domain-Id: default May 19 21:37:04.426967 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Project-Domain-Name: Default May 19 21:37:04.426967 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Project-Id: 120a6c484bec4e52bc5891c927647e75 May 19 21:37:04.426967 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Project-Name: tempest-VolumesSnapshotTestJSON-403570519 May 19 21:37:04.426967 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Role: reader,member May 19 21:37:04.426967 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Roles: reader,member May 19 21:37:04.428465 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/120a6c484bec4e52bc5891c927647e75"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/120a6c484bec4e52bc5891c927647e75"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_120a6c484bec4e52bc5891c927647e75"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/120a6c484bec4e52bc5891c927647e75"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}] May 19 21:37:04.428465 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Tenant: tempest-VolumesSnapshotTestJSON-403570519 May 19 21:37:04.428465 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Tenant-Id: 120a6c484bec4e52bc5891c927647e75 May 19 21:37:04.428465 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-403570519 May 19 21:37:04.428465 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-User: tempest-VolumesSnapshotTestJSON-403570519-project May 19 21:37:04.428465 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-User-Domain-Id: default May 19 21:37:04.428465 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-User-Domain-Name: Default May 19 21:37:04.428465 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-User-Id: 1ad8b76baf294f91bc4c641280ab03f7 May 19 21:37:04.428465 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-User-Name: tempest-VolumesSnapshotTestJSON-403570519-project May 19 21:37:04.428465 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: method: > May 19 21:37:04.428465 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: exception: Instance 8b820379-bb78-465a-a84d-7c1e945c74da could not be found. May 19 21:37:04.428465 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: action_args: {'id': '8b820379-bb78-465a-a84d-7c1e945c74da'} May 19 21:37:04.429316 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 21:37:04.429316 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:37:04.429316 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 21:37:04.429316 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 21:37:04.429316 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 21:37:04.429316 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 21:37:04.429316 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 21:37:04.429316 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 21:37:04.429316 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 21:37:04.429316 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 21:37:04.429316 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b820379-bb78-465a-a84d-7c1e945c74da could not be found. May 19 21:37:04.429316 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:37:04.429316 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 21:37:04.429316 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:37:04.429316 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:37:04.429316 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 21:37:04.429316 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 21:37:04.429316 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 21:37:04.429316 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 21:37:04.429316 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 21:37:04.430811 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 21:37:04.430811 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 21:37:04.430811 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 21:37:04.430811 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 21:37:04.430811 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 21:37:04.430811 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 21:37:04.430811 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 21:37:04.430811 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b820379-bb78-465a-a84d-7c1e945c74da could not be found. May 19 21:37:04.430811 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:37:04.430811 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 21:37:04.430811 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:37:04.430811 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:37:04.430811 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 21:37:04.430811 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 21:37:04.430811 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 21:37:04.430811 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 21:37:04.430811 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b820379-bb78-465a-a84d-7c1e945c74da could not be found. May 19 21:37:04.430811 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:37:04.439587 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-1a309035-b315-48b1-8e4a-1a047813eebc tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Returning 404 to user: Instance 8b820379-bb78-465a-a84d-7c1e945c74da could not be found. {{(pid=124349) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 21:37:04.439587 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-1a309035-b315-48b1-8e4a-1a047813eebc tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] 10.222.0.65 "GET /compute/v2.1/servers/8b820379-bb78-465a-a84d-7c1e945c74da" status: 404 len: 111 microversion: 2.1 time: 0.030779 May 19 21:37:04.439587 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 279/567] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:37:04 2022] GET /compute/v2.1/servers/8b820379-bb78-465a-a84d-7c1e945c74da => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 21:37:04.439840 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-723413e6-e5cf-4a6c-9565-a7b8999950a6 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:37:04.440273 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-723413e6-e5cf-4a6c-9565-a7b8999950a6 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: e0250d7d-3766-4555-a9af-2429afad53bf] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:37:04.447210 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-723413e6-e5cf-4a6c-9565-a7b8999950a6 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:37:04.447909 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-723413e6-e5cf-4a6c-9565-a7b8999950a6 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:37:04.448663 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-723413e6-e5cf-4a6c-9565-a7b8999950a6 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:37:04.449091 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-723413e6-e5cf-4a6c-9565-a7b8999950a6 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:37:04.598882 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-723413e6-e5cf-4a6c-9565-a7b8999950a6 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:37:04.611647 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-723413e6-e5cf-4a6c-9565-a7b8999950a6 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:37:04.613832 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-723413e6-e5cf-4a6c-9565-a7b8999950a6 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:37:04.615295 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-723413e6-e5cf-4a6c-9565-a7b8999950a6 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf" status: 200 len: 1809 microversion: 2.20 time: 0.180484 May 19 21:37:04.616563 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 289/568] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:37:04 2022] GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf => generated 1809 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 21:37:05.635705 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-dcd66bbe-6998-4fc7-bce9-d2325af9740e tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:37:05.636289 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-dcd66bbe-6998-4fc7-bce9-d2325af9740e tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: e0250d7d-3766-4555-a9af-2429afad53bf] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:37:05.643114 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-dcd66bbe-6998-4fc7-bce9-d2325af9740e tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:37:05.643559 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-dcd66bbe-6998-4fc7-bce9-d2325af9740e tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:37:05.644323 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-dcd66bbe-6998-4fc7-bce9-d2325af9740e tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:37:05.644750 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-dcd66bbe-6998-4fc7-bce9-d2325af9740e tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:37:05.790697 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-dcd66bbe-6998-4fc7-bce9-d2325af9740e tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:37:05.802111 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-dcd66bbe-6998-4fc7-bce9-d2325af9740e tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:37:05.803919 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-dcd66bbe-6998-4fc7-bce9-d2325af9740e tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:37:05.805657 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-dcd66bbe-6998-4fc7-bce9-d2325af9740e tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf" status: 200 len: 1809 microversion: 2.20 time: 0.174009 May 19 21:37:05.807208 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 280/569] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:37:05 2022] GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf => generated 1809 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 21:37:06.825619 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-99db6a0a-e899-458c-b12f-79ea3fb8e093 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:37:06.826324 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-99db6a0a-e899-458c-b12f-79ea3fb8e093 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: e0250d7d-3766-4555-a9af-2429afad53bf] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:37:06.834107 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-99db6a0a-e899-458c-b12f-79ea3fb8e093 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:37:06.834732 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-99db6a0a-e899-458c-b12f-79ea3fb8e093 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:37:06.835524 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-99db6a0a-e899-458c-b12f-79ea3fb8e093 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:37:06.836266 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-99db6a0a-e899-458c-b12f-79ea3fb8e093 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:37:06.983920 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-99db6a0a-e899-458c-b12f-79ea3fb8e093 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:37:06.993572 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-99db6a0a-e899-458c-b12f-79ea3fb8e093 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:37:06.995102 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-99db6a0a-e899-458c-b12f-79ea3fb8e093 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:37:06.996298 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-99db6a0a-e899-458c-b12f-79ea3fb8e093 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf" status: 200 len: 1809 microversion: 2.20 time: 0.175310 May 19 21:37:06.996834 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 290/570] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:37:06 2022] GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf => generated 1809 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:37:08.016455 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-b0a710f4-4a6c-497d-bf06-c83ee3bfc593 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:37:08.017017 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-b0a710f4-4a6c-497d-bf06-c83ee3bfc593 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: e0250d7d-3766-4555-a9af-2429afad53bf] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:37:08.024087 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-b0a710f4-4a6c-497d-bf06-c83ee3bfc593 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:37:08.024531 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-b0a710f4-4a6c-497d-bf06-c83ee3bfc593 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:37:08.025493 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-b0a710f4-4a6c-497d-bf06-c83ee3bfc593 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:37:08.025930 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-b0a710f4-4a6c-497d-bf06-c83ee3bfc593 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:37:08.171935 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-b0a710f4-4a6c-497d-bf06-c83ee3bfc593 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:37:08.180957 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-b0a710f4-4a6c-497d-bf06-c83ee3bfc593 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:37:08.182647 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-b0a710f4-4a6c-497d-bf06-c83ee3bfc593 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:37:08.183867 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-b0a710f4-4a6c-497d-bf06-c83ee3bfc593 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf" status: 200 len: 1809 microversion: 2.20 time: 0.171703 May 19 21:37:08.184398 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 281/571] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:37:08 2022] GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf => generated 1809 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:37:09.202971 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-567d098a-1a09-4666-a1e4-d24d602fb4d9 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:37:09.203585 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-567d098a-1a09-4666-a1e4-d24d602fb4d9 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: e0250d7d-3766-4555-a9af-2429afad53bf] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:37:09.211745 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-567d098a-1a09-4666-a1e4-d24d602fb4d9 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:37:09.212145 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-567d098a-1a09-4666-a1e4-d24d602fb4d9 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:37:09.213169 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-567d098a-1a09-4666-a1e4-d24d602fb4d9 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:37:09.214095 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-567d098a-1a09-4666-a1e4-d24d602fb4d9 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:37:09.386287 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-567d098a-1a09-4666-a1e4-d24d602fb4d9 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:37:09.395728 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-567d098a-1a09-4666-a1e4-d24d602fb4d9 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:37:09.397470 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-567d098a-1a09-4666-a1e4-d24d602fb4d9 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:37:09.398804 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-567d098a-1a09-4666-a1e4-d24d602fb4d9 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf" status: 200 len: 1809 microversion: 2.20 time: 0.199841 May 19 21:37:09.399409 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 291/572] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:37:09 2022] GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf => generated 1809 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:37:10.419841 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-c3a31763-776e-4b24-bed8-5e2f9d446190 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:37:10.420487 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-c3a31763-776e-4b24-bed8-5e2f9d446190 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: e0250d7d-3766-4555-a9af-2429afad53bf] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:37:10.427725 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c3a31763-776e-4b24-bed8-5e2f9d446190 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:37:10.428227 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c3a31763-776e-4b24-bed8-5e2f9d446190 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:37:10.429009 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c3a31763-776e-4b24-bed8-5e2f9d446190 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:37:10.429437 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c3a31763-776e-4b24-bed8-5e2f9d446190 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:37:10.630811 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-c3a31763-776e-4b24-bed8-5e2f9d446190 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:37:10.640007 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-c3a31763-776e-4b24-bed8-5e2f9d446190 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:37:10.641511 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-c3a31763-776e-4b24-bed8-5e2f9d446190 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:37:10.642709 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-c3a31763-776e-4b24-bed8-5e2f9d446190 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf" status: 200 len: 1809 microversion: 2.20 time: 0.227456 May 19 21:37:10.643275 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 282/573] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:37:10 2022] GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf => generated 1809 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:37:11.661399 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-57ddef4e-8d2b-45ac-9b49-e9f1d0e0d18c tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:37:11.662086 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-57ddef4e-8d2b-45ac-9b49-e9f1d0e0d18c tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: e0250d7d-3766-4555-a9af-2429afad53bf] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:37:11.669426 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-57ddef4e-8d2b-45ac-9b49-e9f1d0e0d18c tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:37:11.669864 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-57ddef4e-8d2b-45ac-9b49-e9f1d0e0d18c tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:37:11.670674 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-57ddef4e-8d2b-45ac-9b49-e9f1d0e0d18c tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:37:11.671256 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-57ddef4e-8d2b-45ac-9b49-e9f1d0e0d18c tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:37:11.913312 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-57ddef4e-8d2b-45ac-9b49-e9f1d0e0d18c tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:37:11.925684 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-57ddef4e-8d2b-45ac-9b49-e9f1d0e0d18c tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:37:11.927209 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-57ddef4e-8d2b-45ac-9b49-e9f1d0e0d18c tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:37:11.928401 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-57ddef4e-8d2b-45ac-9b49-e9f1d0e0d18c tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf" status: 200 len: 1809 microversion: 2.20 time: 0.271205 May 19 21:37:11.929364 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 292/574] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:37:11 2022] GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf => generated 1809 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:37:12.948429 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-a68437b9-8755-416c-b69a-689b97219930 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:37:12.949018 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-a68437b9-8755-416c-b69a-689b97219930 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: e0250d7d-3766-4555-a9af-2429afad53bf] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:37:12.956223 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a68437b9-8755-416c-b69a-689b97219930 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:37:12.956669 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a68437b9-8755-416c-b69a-689b97219930 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:37:12.957437 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a68437b9-8755-416c-b69a-689b97219930 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:37:12.957860 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a68437b9-8755-416c-b69a-689b97219930 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:37:13.112271 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-a68437b9-8755-416c-b69a-689b97219930 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:37:13.121580 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-a68437b9-8755-416c-b69a-689b97219930 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:37:13.123181 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-a68437b9-8755-416c-b69a-689b97219930 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:37:13.124411 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-a68437b9-8755-416c-b69a-689b97219930 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf" status: 200 len: 1809 microversion: 2.20 time: 0.180470 May 19 21:37:13.125041 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 283/575] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:37:12 2022] GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf => generated 1809 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:37:14.144302 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-803a0fc3-7511-4708-8047-8404d9a49e62 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:37:14.145079 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-803a0fc3-7511-4708-8047-8404d9a49e62 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: e0250d7d-3766-4555-a9af-2429afad53bf] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:37:14.147612 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:37:14.154769 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-803a0fc3-7511-4708-8047-8404d9a49e62 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:37:14.155257 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-803a0fc3-7511-4708-8047-8404d9a49e62 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:37:14.156310 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-803a0fc3-7511-4708-8047-8404d9a49e62 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:37:14.156972 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-803a0fc3-7511-4708-8047-8404d9a49e62 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:37:14.177601 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=5,nova_cell1:UPDATE=6 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:37:14.329936 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-803a0fc3-7511-4708-8047-8404d9a49e62 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:37:14.344714 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-803a0fc3-7511-4708-8047-8404d9a49e62 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:37:14.348100 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-803a0fc3-7511-4708-8047-8404d9a49e62 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:37:14.349458 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-803a0fc3-7511-4708-8047-8404d9a49e62 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf" status: 200 len: 1809 microversion: 2.20 time: 0.209243 May 19 21:37:14.361062 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 293/576] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:37:14 2022] GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf => generated 1809 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:37:15.368502 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-999a6d60-e5f7-40ef-b02b-f05fad0a5f9c tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:37:15.369239 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-999a6d60-e5f7-40ef-b02b-f05fad0a5f9c tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: e0250d7d-3766-4555-a9af-2429afad53bf] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:37:15.372730 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_api:SELECT=48 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:37:15.378730 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-999a6d60-e5f7-40ef-b02b-f05fad0a5f9c tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:37:15.379173 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-999a6d60-e5f7-40ef-b02b-f05fad0a5f9c tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:37:15.379949 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-999a6d60-e5f7-40ef-b02b-f05fad0a5f9c tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:37:15.380747 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-999a6d60-e5f7-40ef-b02b-f05fad0a5f9c tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:37:15.518555 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-999a6d60-e5f7-40ef-b02b-f05fad0a5f9c tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:37:15.520815 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:37:15.528959 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-999a6d60-e5f7-40ef-b02b-f05fad0a5f9c tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:37:15.530461 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-999a6d60-e5f7-40ef-b02b-f05fad0a5f9c tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:37:15.531609 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-999a6d60-e5f7-40ef-b02b-f05fad0a5f9c tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf" status: 200 len: 1809 microversion: 2.20 time: 0.167354 May 19 21:37:15.532166 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 284/577] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:37:15 2022] GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf => generated 1809 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:37:16.551736 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-e98c373f-898f-400b-89a3-007c2833f5dc tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:37:16.552386 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-e98c373f-898f-400b-89a3-007c2833f5dc tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: e0250d7d-3766-4555-a9af-2429afad53bf] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:37:16.559237 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e98c373f-898f-400b-89a3-007c2833f5dc tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:37:16.559689 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e98c373f-898f-400b-89a3-007c2833f5dc tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:37:16.560464 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e98c373f-898f-400b-89a3-007c2833f5dc tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:37:16.560899 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e98c373f-898f-400b-89a3-007c2833f5dc tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:37:16.709898 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-e98c373f-898f-400b-89a3-007c2833f5dc tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:37:16.720772 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-e98c373f-898f-400b-89a3-007c2833f5dc tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:37:16.723069 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-e98c373f-898f-400b-89a3-007c2833f5dc tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:37:16.723617 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-e98c373f-898f-400b-89a3-007c2833f5dc tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf" status: 200 len: 1809 microversion: 2.20 time: 0.175911 May 19 21:37:16.724453 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 294/578] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:37:16 2022] GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf => generated 1809 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 21:37:17.747416 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-1ebdc56e-9d19-4c2d-9ebe-4cc6ad99c77f tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:37:17.748190 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-1ebdc56e-9d19-4c2d-9ebe-4cc6ad99c77f tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: e0250d7d-3766-4555-a9af-2429afad53bf] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:37:17.755236 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1ebdc56e-9d19-4c2d-9ebe-4cc6ad99c77f tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:37:17.756598 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1ebdc56e-9d19-4c2d-9ebe-4cc6ad99c77f tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:37:17.757903 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1ebdc56e-9d19-4c2d-9ebe-4cc6ad99c77f tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:37:17.758112 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1ebdc56e-9d19-4c2d-9ebe-4cc6ad99c77f tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:37:17.924086 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-1ebdc56e-9d19-4c2d-9ebe-4cc6ad99c77f tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:37:17.933627 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-1ebdc56e-9d19-4c2d-9ebe-4cc6ad99c77f tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:37:17.935150 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-1ebdc56e-9d19-4c2d-9ebe-4cc6ad99c77f tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:37:17.936325 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-1ebdc56e-9d19-4c2d-9ebe-4cc6ad99c77f tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf" status: 200 len: 1809 microversion: 2.20 time: 0.195887 May 19 21:37:17.936922 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 285/579] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:37:17 2022] GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf => generated 1809 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:37:18.954216 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-9a8ae582-b632-49ed-88cb-a863bf8a33ae tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:37:18.954917 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-9a8ae582-b632-49ed-88cb-a863bf8a33ae tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: e0250d7d-3766-4555-a9af-2429afad53bf] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:37:18.962276 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9a8ae582-b632-49ed-88cb-a863bf8a33ae tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:37:18.962726 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9a8ae582-b632-49ed-88cb-a863bf8a33ae tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:37:18.963529 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9a8ae582-b632-49ed-88cb-a863bf8a33ae tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:37:18.963945 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9a8ae582-b632-49ed-88cb-a863bf8a33ae tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:37:19.100747 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-9a8ae582-b632-49ed-88cb-a863bf8a33ae tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:37:19.109902 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-9a8ae582-b632-49ed-88cb-a863bf8a33ae tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:37:19.111406 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-9a8ae582-b632-49ed-88cb-a863bf8a33ae tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:37:19.112553 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-9a8ae582-b632-49ed-88cb-a863bf8a33ae tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf" status: 200 len: 1809 microversion: 2.20 time: 0.162381 May 19 21:37:19.113109 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 295/580] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:37:18 2022] GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf => generated 1809 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:37:20.131531 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-8e34b361-f053-4580-a852-42b3548e6f87 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:37:20.132211 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-8e34b361-f053-4580-a852-42b3548e6f87 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: e0250d7d-3766-4555-a9af-2429afad53bf] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:37:20.139590 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-8e34b361-f053-4580-a852-42b3548e6f87 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:37:20.140028 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-8e34b361-f053-4580-a852-42b3548e6f87 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:37:20.140802 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-8e34b361-f053-4580-a852-42b3548e6f87 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:37:20.141225 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-8e34b361-f053-4580-a852-42b3548e6f87 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:37:20.283771 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-8e34b361-f053-4580-a852-42b3548e6f87 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:37:20.294331 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-8e34b361-f053-4580-a852-42b3548e6f87 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:37:20.295839 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-8e34b361-f053-4580-a852-42b3548e6f87 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:37:20.297040 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-8e34b361-f053-4580-a852-42b3548e6f87 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf" status: 200 len: 1809 microversion: 2.20 time: 0.169712 May 19 21:37:20.297594 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 286/581] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:37:20 2022] GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf => generated 1809 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:37:20.654414 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-bc0dd96c-fd80-4402-a9de-bf363d93a925 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1257456365", "imageRef": "a874457a-f8a8-46f6-bdcc-1fa632a0d3c0", "flavorRef": "452", "networks": [{"uuid": "00bbdffb-749b-4e56-86f3-df5fdbc057b9"}]}} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:37:20.711892 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.network.neutron [None req-bc0dd96c-fd80-4402-a9de-bf363d93a925 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] validate_networks() for [('00bbdffb-749b-4e56-86f3-df5fdbc057b9', None, None, None, None, None)] {{(pid=124350) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 19 21:37:21.165934 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.virt.hardware [None req-bc0dd96c-fd80-4402-a9de-bf363d93a925 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Flavor limits 0:0:0 {{(pid=124350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 21:37:21.166434 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.virt.hardware [None req-bc0dd96c-fd80-4402-a9de-bf363d93a925 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Image limits 0:0:0 {{(pid=124350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 21:37:21.166896 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.virt.hardware [None req-bc0dd96c-fd80-4402-a9de-bf363d93a925 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Flavor pref 0:0:0 {{(pid=124350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 21:37:21.167298 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.virt.hardware [None req-bc0dd96c-fd80-4402-a9de-bf363d93a925 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Image pref 0:0:0 {{(pid=124350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 21:37:21.167691 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.virt.hardware [None req-bc0dd96c-fd80-4402-a9de-bf363d93a925 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 21:37:21.177219 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-bc0dd96c-fd80-4402-a9de-bf363d93a925 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:37:21.177656 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-bc0dd96c-fd80-4402-a9de-bf363d93a925 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:37:21.178476 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-bc0dd96c-fd80-4402-a9de-bf363d93a925 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:37:21.178900 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-bc0dd96c-fd80-4402-a9de-bf363d93a925 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:37:21.196050 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.quota [None req-bc0dd96c-fd80-4402-a9de-bf363d93a925 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Getting quotas for project 120a6c484bec4e52bc5891c927647e75. Resources: {'ram', 'cores', 'instances'} {{(pid=124350) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 21:37:21.200181 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.quota [None req-bc0dd96c-fd80-4402-a9de-bf363d93a925 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Getting quotas for user 1ad8b76baf294f91bc4c641280ab03f7 and project 120a6c484bec4e52bc5891c927647e75. Resources: {'ram', 'cores', 'instances'} {{(pid=124350) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 21:37:21.211204 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-bc0dd96c-fd80-4402-a9de-bf363d93a925 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Going to run 1 instances... {{(pid=124350) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 21:37:21.213752 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-bc0dd96c-fd80-4402-a9de-bf363d93a925 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] [instance: e9a11702-a589-4205-9c2e-25322e44ecfe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a874457a-f8a8-46f6-bdcc-1fa632a0d3c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124350) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 21:37:21.258700 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-bc0dd96c-fd80-4402-a9de-bf363d93a925 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.608446 May 19 21:37:21.259525 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 296/582] 10.222.0.65 () {60 vars in 1146 bytes} [Thu May 19 21:37:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 610 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 21:37:21.269716 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-6654cbf9-d4a3-4e5e-a925-641c9b0b03e9 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:37:21.270349 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-6654cbf9-d4a3-4e5e-a925-641c9b0b03e9 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] [instance: e9a11702-a589-4205-9c2e-25322e44ecfe] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:37:21.316440 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-113f0b54-11af-4258-94c5-52252739ea0e tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:37:21.317109 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-113f0b54-11af-4258-94c5-52252739ea0e tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: e0250d7d-3766-4555-a9af-2429afad53bf] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:37:21.324847 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-113f0b54-11af-4258-94c5-52252739ea0e tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:37:21.324847 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-113f0b54-11af-4258-94c5-52252739ea0e tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:37:21.325678 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-113f0b54-11af-4258-94c5-52252739ea0e tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:37:21.326086 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-113f0b54-11af-4258-94c5-52252739ea0e tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:37:21.328511 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-6654cbf9-d4a3-4e5e-a925-641c9b0b03e9 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ad8b76baf294f91bc4c641280ab03f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '120a6c484bec4e52bc5891c927647e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:37:21.339957 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-6654cbf9-d4a3-4e5e-a925-641c9b0b03e9 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] 10.222.0.65 "GET /compute/v2.1/servers/e9a11702-a589-4205-9c2e-25322e44ecfe" status: 200 len: 1219 microversion: 2.1 time: 0.074093 May 19 21:37:21.349326 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 287/583] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:37:21 2022] GET /compute/v2.1/servers/e9a11702-a589-4205-9c2e-25322e44ecfe => generated 1219 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:37:21.463011 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-113f0b54-11af-4258-94c5-52252739ea0e tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:37:21.471561 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-113f0b54-11af-4258-94c5-52252739ea0e tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:37:21.473066 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-113f0b54-11af-4258-94c5-52252739ea0e tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:37:21.474211 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-113f0b54-11af-4258-94c5-52252739ea0e tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf" status: 200 len: 1809 microversion: 2.20 time: 0.161826 May 19 21:37:21.475710 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 297/584] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:37:21 2022] GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf => generated 1809 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 21:37:22.363824 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-2f26686c-22df-4577-9474-cef7c5b3c132 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:37:22.365474 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-2f26686c-22df-4577-9474-cef7c5b3c132 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] [instance: e9a11702-a589-4205-9c2e-25322e44ecfe] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:37:22.375613 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-2f26686c-22df-4577-9474-cef7c5b3c132 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:37:22.376375 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-2f26686c-22df-4577-9474-cef7c5b3c132 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:37:22.377324 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-2f26686c-22df-4577-9474-cef7c5b3c132 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:37:22.378092 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-2f26686c-22df-4577-9474-cef7c5b3c132 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:37:22.485521 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-2f26686c-22df-4577-9474-cef7c5b3c132 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ad8b76baf294f91bc4c641280ab03f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '120a6c484bec4e52bc5891c927647e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:37:22.494465 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-3b2ec815-0929-49fd-b1a1-73bbf58c69cc tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:37:22.496055 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-3b2ec815-0929-49fd-b1a1-73bbf58c69cc tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: e0250d7d-3766-4555-a9af-2429afad53bf] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:37:22.505522 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3b2ec815-0929-49fd-b1a1-73bbf58c69cc tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:37:22.506294 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3b2ec815-0929-49fd-b1a1-73bbf58c69cc tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:37:22.507259 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3b2ec815-0929-49fd-b1a1-73bbf58c69cc tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:37:22.507842 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3b2ec815-0929-49fd-b1a1-73bbf58c69cc tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:37:22.509433 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-2f26686c-22df-4577-9474-cef7c5b3c132 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] 10.222.0.65 "GET /compute/v2.1/servers/e9a11702-a589-4205-9c2e-25322e44ecfe" status: 200 len: 1279 microversion: 2.1 time: 0.150146 May 19 21:37:22.512983 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 288/585] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:37:22 2022] GET /compute/v2.1/servers/e9a11702-a589-4205-9c2e-25322e44ecfe => generated 1279 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:37:22.671309 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-3b2ec815-0929-49fd-b1a1-73bbf58c69cc tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:37:22.681304 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-3b2ec815-0929-49fd-b1a1-73bbf58c69cc tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:37:22.683517 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-3b2ec815-0929-49fd-b1a1-73bbf58c69cc tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:37:22.685058 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-3b2ec815-0929-49fd-b1a1-73bbf58c69cc tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf" status: 200 len: 1809 microversion: 2.20 time: 0.195821 May 19 21:37:22.685833 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 298/586] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:37:22 2022] GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf => generated 1809 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:37:23.530684 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-f9068df8-0222-4f7e-815d-fab7271847b0 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:37:23.531576 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-f9068df8-0222-4f7e-815d-fab7271847b0 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] [instance: e9a11702-a589-4205-9c2e-25322e44ecfe] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:37:23.539028 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f9068df8-0222-4f7e-815d-fab7271847b0 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:37:23.539474 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f9068df8-0222-4f7e-815d-fab7271847b0 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:37:23.540243 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f9068df8-0222-4f7e-815d-fab7271847b0 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:37:23.540664 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f9068df8-0222-4f7e-815d-fab7271847b0 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:37:23.705173 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-e4e04e3f-b78a-4481-aefd-fce6b84d1ddc tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:37:23.705788 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-e4e04e3f-b78a-4481-aefd-fce6b84d1ddc tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: e0250d7d-3766-4555-a9af-2429afad53bf] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:37:23.713769 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e4e04e3f-b78a-4481-aefd-fce6b84d1ddc tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:37:23.714034 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e4e04e3f-b78a-4481-aefd-fce6b84d1ddc tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:37:23.714779 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e4e04e3f-b78a-4481-aefd-fce6b84d1ddc tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:37:23.715209 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e4e04e3f-b78a-4481-aefd-fce6b84d1ddc tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:37:23.749416 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-f9068df8-0222-4f7e-815d-fab7271847b0 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ad8b76baf294f91bc4c641280ab03f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '120a6c484bec4e52bc5891c927647e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:37:23.757985 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-f9068df8-0222-4f7e-815d-fab7271847b0 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] 10.222.0.65 "GET /compute/v2.1/servers/e9a11702-a589-4205-9c2e-25322e44ecfe" status: 200 len: 1319 microversion: 2.1 time: 0.232395 May 19 21:37:23.759589 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 289/587] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:37:23 2022] GET /compute/v2.1/servers/e9a11702-a589-4205-9c2e-25322e44ecfe => generated 1319 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:37:23.878600 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-e4e04e3f-b78a-4481-aefd-fce6b84d1ddc tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:37:23.888007 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-e4e04e3f-b78a-4481-aefd-fce6b84d1ddc tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:37:23.889508 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-e4e04e3f-b78a-4481-aefd-fce6b84d1ddc tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:37:23.890715 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-e4e04e3f-b78a-4481-aefd-fce6b84d1ddc tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf" status: 200 len: 1809 microversion: 2.20 time: 0.189580 May 19 21:37:23.891350 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 299/588] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:37:23 2022] GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf => generated 1809 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:37:24.081089 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [req-47e08b6c-835f-47ab-8507-7d965f9b8796 req-f8f4bde7-8201-4241-babf-027dfe0f7ac1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9a11702-a589-4205-9c2e-25322e44ecfe", "tag": "bd8d518d-9ed5-430e-bea4-b9bd5b79cbbb"}]} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:37:24.090853 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-47e08b6c-835f-47ab-8507-7d965f9b8796 req-f8f4bde7-8201-4241-babf-027dfe0f7ac1 service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:37:24.091356 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-47e08b6c-835f-47ab-8507-7d965f9b8796 req-f8f4bde7-8201-4241-babf-027dfe0f7ac1 service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:37:24.114729 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.compute.server_external_events [req-47e08b6c-835f-47ab-8507-7d965f9b8796 req-f8f4bde7-8201-4241-babf-027dfe0f7ac1 service nova] Creating event network-changed:bd8d518d-9ed5-430e-bea4-b9bd5b79cbbb for instance e9a11702-a589-4205-9c2e-25322e44ecfe on hv-cinder-83563 May 19 21:37:24.121275 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [req-47e08b6c-835f-47ab-8507-7d965f9b8796 req-f8f4bde7-8201-4241-babf-027dfe0f7ac1 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044268 May 19 21:37:24.121877 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 290/589] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 21:37:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 21:37:24.776901 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-5b4944fd-af4b-4eab-b4dc-58bb77818af0 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:37:24.777540 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-5b4944fd-af4b-4eab-b4dc-58bb77818af0 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] [instance: e9a11702-a589-4205-9c2e-25322e44ecfe] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:37:24.784734 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5b4944fd-af4b-4eab-b4dc-58bb77818af0 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:37:24.785179 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5b4944fd-af4b-4eab-b4dc-58bb77818af0 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:37:24.785940 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5b4944fd-af4b-4eab-b4dc-58bb77818af0 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:37:24.786404 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5b4944fd-af4b-4eab-b4dc-58bb77818af0 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:37:24.913097 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-55720870-3298-47b7-b125-84a4e530f77c tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:37:24.913805 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-55720870-3298-47b7-b125-84a4e530f77c tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: e0250d7d-3766-4555-a9af-2429afad53bf] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:37:24.923227 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-55720870-3298-47b7-b125-84a4e530f77c tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:37:24.923679 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-55720870-3298-47b7-b125-84a4e530f77c tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:37:24.924827 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-55720870-3298-47b7-b125-84a4e530f77c tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:37:24.925482 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-55720870-3298-47b7-b125-84a4e530f77c tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:37:24.943581 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-5b4944fd-af4b-4eab-b4dc-58bb77818af0 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ad8b76baf294f91bc4c641280ab03f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '120a6c484bec4e52bc5891c927647e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:37:24.952012 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-5b4944fd-af4b-4eab-b4dc-58bb77818af0 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] 10.222.0.65 "GET /compute/v2.1/servers/e9a11702-a589-4205-9c2e-25322e44ecfe" status: 200 len: 1319 microversion: 2.1 time: 0.179534 May 19 21:37:24.952594 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 300/590] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:37:24 2022] GET /compute/v2.1/servers/e9a11702-a589-4205-9c2e-25322e44ecfe => generated 1319 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:37:25.069570 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-55720870-3298-47b7-b125-84a4e530f77c tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:37:25.079849 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-55720870-3298-47b7-b125-84a4e530f77c tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:37:25.081325 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-55720870-3298-47b7-b125-84a4e530f77c tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:37:25.082505 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-55720870-3298-47b7-b125-84a4e530f77c tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf" status: 200 len: 1809 microversion: 2.20 time: 0.176058 May 19 21:37:25.083241 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 291/591] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:37:24 2022] GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf => generated 1809 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:37:25.969540 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-3dd3d14b-88b9-4ec4-b29c-4c541164d22f tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:37:25.970112 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-3dd3d14b-88b9-4ec4-b29c-4c541164d22f tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] [instance: e9a11702-a589-4205-9c2e-25322e44ecfe] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:37:25.977289 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3dd3d14b-88b9-4ec4-b29c-4c541164d22f tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:37:25.977733 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3dd3d14b-88b9-4ec4-b29c-4c541164d22f tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:37:25.978860 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3dd3d14b-88b9-4ec4-b29c-4c541164d22f tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:37:25.979362 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3dd3d14b-88b9-4ec4-b29c-4c541164d22f tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:37:26.103917 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-fe436d4f-6fd1-47ff-8eb2-c85b046e3932 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:37:26.104733 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-fe436d4f-6fd1-47ff-8eb2-c85b046e3932 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: e0250d7d-3766-4555-a9af-2429afad53bf] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:37:26.111403 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-fe436d4f-6fd1-47ff-8eb2-c85b046e3932 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:37:26.111847 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-fe436d4f-6fd1-47ff-8eb2-c85b046e3932 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:37:26.112625 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-fe436d4f-6fd1-47ff-8eb2-c85b046e3932 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:37:26.113053 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-fe436d4f-6fd1-47ff-8eb2-c85b046e3932 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:37:26.135343 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-3dd3d14b-88b9-4ec4-b29c-4c541164d22f tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ad8b76baf294f91bc4c641280ab03f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '120a6c484bec4e52bc5891c927647e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:37:26.149048 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-3dd3d14b-88b9-4ec4-b29c-4c541164d22f tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] 10.222.0.65 "GET /compute/v2.1/servers/e9a11702-a589-4205-9c2e-25322e44ecfe" status: 200 len: 1319 microversion: 2.1 time: 0.182961 May 19 21:37:26.150078 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 301/592] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:37:25 2022] GET /compute/v2.1/servers/e9a11702-a589-4205-9c2e-25322e44ecfe => generated 1319 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:37:26.258709 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-fe436d4f-6fd1-47ff-8eb2-c85b046e3932 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:37:26.267544 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-fe436d4f-6fd1-47ff-8eb2-c85b046e3932 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:37:26.269030 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-fe436d4f-6fd1-47ff-8eb2-c85b046e3932 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:37:26.270810 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-fe436d4f-6fd1-47ff-8eb2-c85b046e3932 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf" status: 200 len: 1809 microversion: 2.20 time: 0.170689 May 19 21:37:26.270810 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 292/593] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:37:26 2022] GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf => generated 1809 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 21:37:26.831721 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 21:37:26.832004 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Thu May 19 21:37:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 19 21:37:27.173921 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-38a5e910-3c68-4889-9d81-cc902599ebb2 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:37:27.174572 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-38a5e910-3c68-4889-9d81-cc902599ebb2 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] [instance: e9a11702-a589-4205-9c2e-25322e44ecfe] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:37:27.181917 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-38a5e910-3c68-4889-9d81-cc902599ebb2 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:37:27.182524 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-38a5e910-3c68-4889-9d81-cc902599ebb2 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:37:27.183371 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-38a5e910-3c68-4889-9d81-cc902599ebb2 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:37:27.183798 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-38a5e910-3c68-4889-9d81-cc902599ebb2 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:37:27.337945 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-38a5e910-3c68-4889-9d81-cc902599ebb2 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ad8b76baf294f91bc4c641280ab03f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '120a6c484bec4e52bc5891c927647e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:37:27.346065 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-38a5e910-3c68-4889-9d81-cc902599ebb2 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] 10.222.0.65 "GET /compute/v2.1/servers/e9a11702-a589-4205-9c2e-25322e44ecfe" status: 200 len: 1319 microversion: 2.1 time: 0.176021 May 19 21:37:27.346672 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 302/594] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:37:27 2022] GET /compute/v2.1/servers/e9a11702-a589-4205-9c2e-25322e44ecfe => generated 1319 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:37:27.423314 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-2e074ff9-d319-4789-a7a3-fecfc0d12524 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:37:27.423920 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-2e074ff9-d319-4789-a7a3-fecfc0d12524 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: e0250d7d-3766-4555-a9af-2429afad53bf] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:37:27.431486 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-2e074ff9-d319-4789-a7a3-fecfc0d12524 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:37:27.431831 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-2e074ff9-d319-4789-a7a3-fecfc0d12524 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:37:27.432631 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-2e074ff9-d319-4789-a7a3-fecfc0d12524 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:37:27.433094 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-2e074ff9-d319-4789-a7a3-fecfc0d12524 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:37:27.584422 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-2e074ff9-d319-4789-a7a3-fecfc0d12524 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:37:27.594694 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-2e074ff9-d319-4789-a7a3-fecfc0d12524 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:37:27.596212 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-2e074ff9-d319-4789-a7a3-fecfc0d12524 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:37:27.597391 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-2e074ff9-d319-4789-a7a3-fecfc0d12524 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf" status: 200 len: 1809 microversion: 2.20 time: 0.312250 May 19 21:37:27.598022 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 293/595] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:37:27 2022] GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf => generated 1809 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:37:28.362750 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-a1457f5d-0413-472e-a3b8-fff87641da94 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:37:28.364780 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-a1457f5d-0413-472e-a3b8-fff87641da94 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] [instance: e9a11702-a589-4205-9c2e-25322e44ecfe] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:37:28.370606 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a1457f5d-0413-472e-a3b8-fff87641da94 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:37:28.371053 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a1457f5d-0413-472e-a3b8-fff87641da94 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:37:28.371845 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a1457f5d-0413-472e-a3b8-fff87641da94 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:37:28.372274 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a1457f5d-0413-472e-a3b8-fff87641da94 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:37:28.520533 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-a1457f5d-0413-472e-a3b8-fff87641da94 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ad8b76baf294f91bc4c641280ab03f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '120a6c484bec4e52bc5891c927647e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:37:28.530466 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-a1457f5d-0413-472e-a3b8-fff87641da94 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] 10.222.0.65 "GET /compute/v2.1/servers/e9a11702-a589-4205-9c2e-25322e44ecfe" status: 200 len: 1319 microversion: 2.1 time: 0.171690 May 19 21:37:28.531027 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 303/596] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:37:28 2022] GET /compute/v2.1/servers/e9a11702-a589-4205-9c2e-25322e44ecfe => generated 1319 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:37:28.617824 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-bf658511-8f81-41c3-b11f-68fb1786a104 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:37:28.618517 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-bf658511-8f81-41c3-b11f-68fb1786a104 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: e0250d7d-3766-4555-a9af-2429afad53bf] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:37:28.626507 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-bf658511-8f81-41c3-b11f-68fb1786a104 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:37:28.627054 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-bf658511-8f81-41c3-b11f-68fb1786a104 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:37:28.627936 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-bf658511-8f81-41c3-b11f-68fb1786a104 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:37:28.628511 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-bf658511-8f81-41c3-b11f-68fb1786a104 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:37:28.773083 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-bf658511-8f81-41c3-b11f-68fb1786a104 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:37:28.782519 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-bf658511-8f81-41c3-b11f-68fb1786a104 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:37:28.784016 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-bf658511-8f81-41c3-b11f-68fb1786a104 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:37:28.785172 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-bf658511-8f81-41c3-b11f-68fb1786a104 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf" status: 200 len: 1809 microversion: 2.20 time: 0.171500 May 19 21:37:28.785741 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 294/597] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:37:28 2022] GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf => generated 1809 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:37:29.251006 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 21:37:29.251300 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Thu May 19 21:37:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 19 21:37:29.550216 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-e72e2bc1-cf65-4a7f-98cc-01977db62ee0 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:37:29.550952 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-e72e2bc1-cf65-4a7f-98cc-01977db62ee0 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] [instance: e9a11702-a589-4205-9c2e-25322e44ecfe] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:37:29.559108 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e72e2bc1-cf65-4a7f-98cc-01977db62ee0 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:37:29.559570 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e72e2bc1-cf65-4a7f-98cc-01977db62ee0 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:37:29.560329 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e72e2bc1-cf65-4a7f-98cc-01977db62ee0 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:37:29.560756 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e72e2bc1-cf65-4a7f-98cc-01977db62ee0 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:37:29.710446 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-e72e2bc1-cf65-4a7f-98cc-01977db62ee0 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ad8b76baf294f91bc4c641280ab03f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '120a6c484bec4e52bc5891c927647e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:37:29.718728 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-e72e2bc1-cf65-4a7f-98cc-01977db62ee0 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] 10.222.0.65 "GET /compute/v2.1/servers/e9a11702-a589-4205-9c2e-25322e44ecfe" status: 200 len: 1319 microversion: 2.1 time: 0.172222 May 19 21:37:29.719296 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 304/598] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:37:29 2022] GET /compute/v2.1/servers/e9a11702-a589-4205-9c2e-25322e44ecfe => generated 1319 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:37:29.805040 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-799bc78e-e34a-4730-a8d4-97c18be86986 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:37:29.805694 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-799bc78e-e34a-4730-a8d4-97c18be86986 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: e0250d7d-3766-4555-a9af-2429afad53bf] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:37:29.813596 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-799bc78e-e34a-4730-a8d4-97c18be86986 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:37:29.814090 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-799bc78e-e34a-4730-a8d4-97c18be86986 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:37:29.815326 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-799bc78e-e34a-4730-a8d4-97c18be86986 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:37:29.815859 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-799bc78e-e34a-4730-a8d4-97c18be86986 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:37:29.959016 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-799bc78e-e34a-4730-a8d4-97c18be86986 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:37:29.968818 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-799bc78e-e34a-4730-a8d4-97c18be86986 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:37:29.970335 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-799bc78e-e34a-4730-a8d4-97c18be86986 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:37:29.971528 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-799bc78e-e34a-4730-a8d4-97c18be86986 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf" status: 200 len: 1809 microversion: 2.20 time: 0.170948 May 19 21:37:29.972077 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 295/599] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:37:29 2022] GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf => generated 1809 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:37:30.736852 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-1b71d7e6-90e0-4c81-8fc6-3746082aebd8 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:37:30.737798 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-1b71d7e6-90e0-4c81-8fc6-3746082aebd8 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] [instance: e9a11702-a589-4205-9c2e-25322e44ecfe] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:37:30.745238 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1b71d7e6-90e0-4c81-8fc6-3746082aebd8 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:37:30.745687 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1b71d7e6-90e0-4c81-8fc6-3746082aebd8 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:37:30.746472 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1b71d7e6-90e0-4c81-8fc6-3746082aebd8 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:37:30.746902 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1b71d7e6-90e0-4c81-8fc6-3746082aebd8 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:37:30.889548 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-1b71d7e6-90e0-4c81-8fc6-3746082aebd8 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ad8b76baf294f91bc4c641280ab03f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '120a6c484bec4e52bc5891c927647e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:37:30.897825 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-1b71d7e6-90e0-4c81-8fc6-3746082aebd8 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] 10.222.0.65 "GET /compute/v2.1/servers/e9a11702-a589-4205-9c2e-25322e44ecfe" status: 200 len: 1319 microversion: 2.1 time: 0.164969 May 19 21:37:30.898488 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 305/600] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:37:30 2022] GET /compute/v2.1/servers/e9a11702-a589-4205-9c2e-25322e44ecfe => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:37:30.990559 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-e8ed498d-3462-43d2-87e5-4ca33d379430 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:37:30.991254 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-e8ed498d-3462-43d2-87e5-4ca33d379430 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: e0250d7d-3766-4555-a9af-2429afad53bf] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:37:30.998569 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e8ed498d-3462-43d2-87e5-4ca33d379430 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:37:30.999016 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e8ed498d-3462-43d2-87e5-4ca33d379430 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:37:30.999788 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e8ed498d-3462-43d2-87e5-4ca33d379430 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:37:31.000219 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e8ed498d-3462-43d2-87e5-4ca33d379430 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:37:31.223695 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-e8ed498d-3462-43d2-87e5-4ca33d379430 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:37:31.234629 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [req-e849205c-8aa4-4116-9a21-5727fdcdc31b req-31f973c9-9601-4260-a5bd-4a3539864ed4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9a11702-a589-4205-9c2e-25322e44ecfe", "name": "network-vif-plugged", "status": "completed", "tag": "bd8d518d-9ed5-430e-bea4-b9bd5b79cbbb"}]} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:37:31.245220 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell0:SELECT=2 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:37:31.249170 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-e8ed498d-3462-43d2-87e5-4ca33d379430 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:37:31.250929 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell0:SELECT=6 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:37:31.253880 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-e849205c-8aa4-4116-9a21-5727fdcdc31b req-31f973c9-9601-4260-a5bd-4a3539864ed4 service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:37:31.255840 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-e8ed498d-3462-43d2-87e5-4ca33d379430 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:37:31.256380 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-e849205c-8aa4-4116-9a21-5727fdcdc31b req-31f973c9-9601-4260-a5bd-4a3539864ed4 service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:37:31.257703 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-e8ed498d-3462-43d2-87e5-4ca33d379430 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf" status: 200 len: 1809 microversion: 2.20 time: 0.271130 May 19 21:37:31.262015 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 296/601] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:37:30 2022] GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf => generated 1809 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:37:31.279348 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.compute.server_external_events [req-e849205c-8aa4-4116-9a21-5727fdcdc31b req-31f973c9-9601-4260-a5bd-4a3539864ed4 service nova] Creating event network-vif-plugged:bd8d518d-9ed5-430e-bea4-b9bd5b79cbbb for instance e9a11702-a589-4205-9c2e-25322e44ecfe on hv-cinder-83563 May 19 21:37:31.284781 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [req-e849205c-8aa4-4116-9a21-5727fdcdc31b req-31f973c9-9601-4260-a5bd-4a3539864ed4 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054063 May 19 21:37:31.285385 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 306/602] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 21:37:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 21:37:31.917860 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-fd3e2482-bcb4-49e2-8ceb-4f5193259071 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:37:31.918526 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-fd3e2482-bcb4-49e2-8ceb-4f5193259071 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] [instance: e9a11702-a589-4205-9c2e-25322e44ecfe] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:37:31.920477 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_cell0:SELECT=2 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:37:31.925998 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-fd3e2482-bcb4-49e2-8ceb-4f5193259071 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:37:31.926461 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-fd3e2482-bcb4-49e2-8ceb-4f5193259071 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:37:31.927245 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-fd3e2482-bcb4-49e2-8ceb-4f5193259071 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:37:31.927676 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-fd3e2482-bcb4-49e2-8ceb-4f5193259071 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:37:32.067308 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-fd3e2482-bcb4-49e2-8ceb-4f5193259071 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ad8b76baf294f91bc4c641280ab03f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '120a6c484bec4e52bc5891c927647e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:37:32.075474 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-fd3e2482-bcb4-49e2-8ceb-4f5193259071 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] 10.222.0.65 "GET /compute/v2.1/servers/e9a11702-a589-4205-9c2e-25322e44ecfe" status: 200 len: 1319 microversion: 2.1 time: 0.162069 May 19 21:37:32.076051 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 297/603] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:37:31 2022] GET /compute/v2.1/servers/e9a11702-a589-4205-9c2e-25322e44ecfe => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:37:32.282048 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-f8d7c803-14e7-430a-9cd9-3c693a75d0b9 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:37:32.282642 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-f8d7c803-14e7-430a-9cd9-3c693a75d0b9 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: e0250d7d-3766-4555-a9af-2429afad53bf] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:37:32.289232 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f8d7c803-14e7-430a-9cd9-3c693a75d0b9 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:37:32.289670 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f8d7c803-14e7-430a-9cd9-3c693a75d0b9 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:37:32.290456 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f8d7c803-14e7-430a-9cd9-3c693a75d0b9 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:37:32.290956 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f8d7c803-14e7-430a-9cd9-3c693a75d0b9 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:37:32.428414 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-f8d7c803-14e7-430a-9cd9-3c693a75d0b9 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:37:32.438135 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-f8d7c803-14e7-430a-9cd9-3c693a75d0b9 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:37:32.439657 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-f8d7c803-14e7-430a-9cd9-3c693a75d0b9 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:37:32.440835 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-f8d7c803-14e7-430a-9cd9-3c693a75d0b9 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf" status: 200 len: 1809 microversion: 2.20 time: 0.163761 May 19 21:37:32.441387 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 307/604] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:37:32 2022] GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf => generated 1809 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:37:33.093119 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-04e5ccb6-00c8-4741-8694-f65797f58804 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:37:33.093840 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-04e5ccb6-00c8-4741-8694-f65797f58804 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] [instance: e9a11702-a589-4205-9c2e-25322e44ecfe] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:37:33.101172 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-04e5ccb6-00c8-4741-8694-f65797f58804 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:37:33.101609 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-04e5ccb6-00c8-4741-8694-f65797f58804 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:37:33.102417 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-04e5ccb6-00c8-4741-8694-f65797f58804 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:37:33.103100 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-04e5ccb6-00c8-4741-8694-f65797f58804 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:37:33.244414 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-04e5ccb6-00c8-4741-8694-f65797f58804 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ad8b76baf294f91bc4c641280ab03f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '120a6c484bec4e52bc5891c927647e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:37:33.253605 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-04e5ccb6-00c8-4741-8694-f65797f58804 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] 10.222.0.65 "GET /compute/v2.1/servers/e9a11702-a589-4205-9c2e-25322e44ecfe" status: 200 len: 1319 microversion: 2.1 time: 0.163261 May 19 21:37:33.253605 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 298/605] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:37:33 2022] GET /compute/v2.1/servers/e9a11702-a589-4205-9c2e-25322e44ecfe => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:37:33.459750 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-3ca5cf52-460f-4676-a09b-b65dfa28a0cb tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:37:33.460917 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-3ca5cf52-460f-4676-a09b-b65dfa28a0cb tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: e0250d7d-3766-4555-a9af-2429afad53bf] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:37:33.469334 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3ca5cf52-460f-4676-a09b-b65dfa28a0cb tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:37:33.469845 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3ca5cf52-460f-4676-a09b-b65dfa28a0cb tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:37:33.470820 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3ca5cf52-460f-4676-a09b-b65dfa28a0cb tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:37:33.471536 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3ca5cf52-460f-4676-a09b-b65dfa28a0cb tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:37:33.618317 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-3ca5cf52-460f-4676-a09b-b65dfa28a0cb tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:37:33.627052 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-3ca5cf52-460f-4676-a09b-b65dfa28a0cb tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:37:33.628543 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-3ca5cf52-460f-4676-a09b-b65dfa28a0cb tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:37:33.629697 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-3ca5cf52-460f-4676-a09b-b65dfa28a0cb tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf" status: 200 len: 1809 microversion: 2.20 time: 0.173845 May 19 21:37:33.630280 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 308/606] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:37:33 2022] GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf => generated 1809 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:37:34.273366 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-b463f7d6-3e82-4157-9307-8ce8a559a3e4 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:37:34.273980 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-b463f7d6-3e82-4157-9307-8ce8a559a3e4 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] [instance: e9a11702-a589-4205-9c2e-25322e44ecfe] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:37:34.281518 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-b463f7d6-3e82-4157-9307-8ce8a559a3e4 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:37:34.281990 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-b463f7d6-3e82-4157-9307-8ce8a559a3e4 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:37:34.282796 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-b463f7d6-3e82-4157-9307-8ce8a559a3e4 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:37:34.283222 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-b463f7d6-3e82-4157-9307-8ce8a559a3e4 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:37:34.425328 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-b463f7d6-3e82-4157-9307-8ce8a559a3e4 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ad8b76baf294f91bc4c641280ab03f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '120a6c484bec4e52bc5891c927647e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:37:34.433152 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-b463f7d6-3e82-4157-9307-8ce8a559a3e4 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] 10.222.0.65 "GET /compute/v2.1/servers/e9a11702-a589-4205-9c2e-25322e44ecfe" status: 200 len: 1507 microversion: 2.1 time: 0.165713 May 19 21:37:34.433717 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 299/607] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:37:34 2022] GET /compute/v2.1/servers/e9a11702-a589-4205-9c2e-25322e44ecfe => generated 1507 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:37:34.451600 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-8c53fc93-3715-4e9a-bb79-8cd9d3757591 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ada52826-7070-45d7-94d9-1b71d9455068", "device": "/dev/sdb"}} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:37:34.452684 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-8c53fc93-3715-4e9a-bb79-8cd9d3757591 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] [instance: e9a11702-a589-4205-9c2e-25322e44ecfe] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:37:34.459393 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8c53fc93-3715-4e9a-bb79-8cd9d3757591 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:37:34.459393 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8c53fc93-3715-4e9a-bb79-8cd9d3757591 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:37:34.460475 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8c53fc93-3715-4e9a-bb79-8cd9d3757591 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:37:34.461045 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8c53fc93-3715-4e9a-bb79-8cd9d3757591 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:37:34.654722 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-de42c3ff-0a46-4cfe-a606-e2212a81e58e tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:37:34.655333 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-de42c3ff-0a46-4cfe-a606-e2212a81e58e tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: e0250d7d-3766-4555-a9af-2429afad53bf] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:37:34.661724 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-de42c3ff-0a46-4cfe-a606-e2212a81e58e tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:37:34.662174 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-de42c3ff-0a46-4cfe-a606-e2212a81e58e tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:37:34.662991 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-de42c3ff-0a46-4cfe-a606-e2212a81e58e tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:37:34.663481 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-de42c3ff-0a46-4cfe-a606-e2212a81e58e tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:37:34.719997 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-8c53fc93-3715-4e9a-bb79-8cd9d3757591 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] 10.222.0.65 "POST /compute/v2.1/servers/e9a11702-a589-4205-9c2e-25322e44ecfe/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.272287 May 19 21:37:34.725157 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 309/608] 10.222.0.65 () {60 vars in 1322 bytes} [Thu May 19 21:37:34 2022] POST /compute/v2.1/servers/e9a11702-a589-4205-9c2e-25322e44ecfe/os-volume_attachments => generated 194 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 21:37:34.816853 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-de42c3ff-0a46-4cfe-a606-e2212a81e58e tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:37:34.825564 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-de42c3ff-0a46-4cfe-a606-e2212a81e58e tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:37:34.827090 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-de42c3ff-0a46-4cfe-a606-e2212a81e58e tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:37:34.828313 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-de42c3ff-0a46-4cfe-a606-e2212a81e58e tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf" status: 200 len: 1809 microversion: 2.20 time: 0.179656 May 19 21:37:34.828875 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 300/609] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:37:34 2022] GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf => generated 1809 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 21:37:35.397701 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [req-116b1ddf-8a81-4d29-8bed-a7c184d52770 req-abe3c7e6-a5ab-4415-869d-8040e6a6fbb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0250d7d-3766-4555-a9af-2429afad53bf", "name": "network-vif-plugged", "status": "completed", "tag": "7fe0112e-1449-4e73-9fa1-f6d3a33168d8"}]} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:37:35.409000 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-116b1ddf-8a81-4d29-8bed-a7c184d52770 req-abe3c7e6-a5ab-4415-869d-8040e6a6fbb7 service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:37:35.409424 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-116b1ddf-8a81-4d29-8bed-a7c184d52770 req-abe3c7e6-a5ab-4415-869d-8040e6a6fbb7 service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:37:35.413959 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:37:35.422209 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.compute.server_external_events [req-116b1ddf-8a81-4d29-8bed-a7c184d52770 req-abe3c7e6-a5ab-4415-869d-8040e6a6fbb7 service nova] Creating event network-vif-plugged:7fe0112e-1449-4e73-9fa1-f6d3a33168d8 for instance e0250d7d-3766-4555-a9af-2429afad53bf on hv-cinder-83563 May 19 21:37:35.427283 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [req-116b1ddf-8a81-4d29-8bed-a7c184d52770 req-abe3c7e6-a5ab-4415-869d-8040e6a6fbb7 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034277 May 19 21:37:35.430622 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 310/610] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 21:37:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 21:37:35.846437 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-602397b0-cf58-45c5-a109-4a175e2dd6a4 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:37:35.847022 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-602397b0-cf58-45c5-a109-4a175e2dd6a4 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: e0250d7d-3766-4555-a9af-2429afad53bf] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:37:35.854898 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-602397b0-cf58-45c5-a109-4a175e2dd6a4 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:37:35.855363 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-602397b0-cf58-45c5-a109-4a175e2dd6a4 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:37:35.856100 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-602397b0-cf58-45c5-a109-4a175e2dd6a4 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:37:35.856559 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-602397b0-cf58-45c5-a109-4a175e2dd6a4 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:37:36.003957 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-602397b0-cf58-45c5-a109-4a175e2dd6a4 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:37:36.015588 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-602397b0-cf58-45c5-a109-4a175e2dd6a4 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:37:36.017847 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-602397b0-cf58-45c5-a109-4a175e2dd6a4 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:37:36.019339 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-602397b0-cf58-45c5-a109-4a175e2dd6a4 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf" status: 200 len: 1809 microversion: 2.20 time: 0.177001 May 19 21:37:36.019995 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 301/611] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:37:35 2022] GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf => generated 1809 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:37:37.041246 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-d4f3979a-2cfc-4567-acab-7614a2ffdc7e tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:37:37.041838 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-d4f3979a-2cfc-4567-acab-7614a2ffdc7e tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: e0250d7d-3766-4555-a9af-2429afad53bf] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:37:37.048594 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d4f3979a-2cfc-4567-acab-7614a2ffdc7e tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:37:37.049035 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d4f3979a-2cfc-4567-acab-7614a2ffdc7e tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:37:37.049804 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d4f3979a-2cfc-4567-acab-7614a2ffdc7e tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:37:37.050271 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d4f3979a-2cfc-4567-acab-7614a2ffdc7e tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:37:37.192066 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-d4f3979a-2cfc-4567-acab-7614a2ffdc7e tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:37:37.201726 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-d4f3979a-2cfc-4567-acab-7614a2ffdc7e tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:37:37.203243 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-d4f3979a-2cfc-4567-acab-7614a2ffdc7e tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:37:37.204398 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-d4f3979a-2cfc-4567-acab-7614a2ffdc7e tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf" status: 200 len: 1809 microversion: 2.20 time: 0.168818 May 19 21:37:37.204954 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 311/612] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:37:37 2022] GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf => generated 1809 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:37:38.224160 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-beb7f4a9-50b0-418c-b887-ab4819352b53 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:37:38.224705 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-beb7f4a9-50b0-418c-b887-ab4819352b53 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: e0250d7d-3766-4555-a9af-2429afad53bf] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:37:38.232142 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-beb7f4a9-50b0-418c-b887-ab4819352b53 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:37:38.232587 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-beb7f4a9-50b0-418c-b887-ab4819352b53 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:37:38.233343 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-beb7f4a9-50b0-418c-b887-ab4819352b53 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:37:38.233768 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-beb7f4a9-50b0-418c-b887-ab4819352b53 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:37:38.384915 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-beb7f4a9-50b0-418c-b887-ab4819352b53 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:37:38.394840 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-beb7f4a9-50b0-418c-b887-ab4819352b53 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:37:38.396388 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-beb7f4a9-50b0-418c-b887-ab4819352b53 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:37:38.397645 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-beb7f4a9-50b0-418c-b887-ab4819352b53 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf" status: 200 len: 1809 microversion: 2.20 time: 0.177743 May 19 21:37:38.398206 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 302/613] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:37:38 2022] GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf => generated 1809 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:37:39.418758 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-43752785-4137-4c61-87ed-73ef4936b317 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:37:39.419629 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-43752785-4137-4c61-87ed-73ef4936b317 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: e0250d7d-3766-4555-a9af-2429afad53bf] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:37:39.427660 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-43752785-4137-4c61-87ed-73ef4936b317 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:37:39.428549 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-43752785-4137-4c61-87ed-73ef4936b317 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:37:39.429173 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-43752785-4137-4c61-87ed-73ef4936b317 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:37:39.429707 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-43752785-4137-4c61-87ed-73ef4936b317 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:37:39.575194 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-43752785-4137-4c61-87ed-73ef4936b317 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:37:39.586090 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-43752785-4137-4c61-87ed-73ef4936b317 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:37:39.587894 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-43752785-4137-4c61-87ed-73ef4936b317 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:37:39.589096 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-43752785-4137-4c61-87ed-73ef4936b317 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf" status: 200 len: 1796 microversion: 2.20 time: 0.175441 May 19 21:37:39.589623 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 312/614] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:37:39 2022] GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf => generated 1796 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:37:58.309183 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-ee26c0ce-4db6-41ed-aad6-874ade5d334a tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:37:58.310032 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-ee26c0ce-4db6-41ed-aad6-874ade5d334a tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] [instance: e9a11702-a589-4205-9c2e-25322e44ecfe] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:37:58.314173 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_api:SELECT=39 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:37:58.315364 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_cell1:SELECT=99 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:37:58.326106 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ee26c0ce-4db6-41ed-aad6-874ade5d334a tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:37:58.327036 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ee26c0ce-4db6-41ed-aad6-874ade5d334a tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:37:58.328222 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ee26c0ce-4db6-41ed-aad6-874ade5d334a tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:37:58.328841 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ee26c0ce-4db6-41ed-aad6-874ade5d334a tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:37:58.451756 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.objects.instance [None req-ee26c0ce-4db6-41ed-aad6-874ade5d334a tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lazy-loading 'services' on Instance uuid e9a11702-a589-4205-9c2e-25322e44ecfe {{(pid=124349) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 21:37:58.543459 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-ee26c0ce-4db6-41ed-aad6-874ade5d334a tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] 10.222.0.65 "DELETE /compute/v2.1/servers/e9a11702-a589-4205-9c2e-25322e44ecfe/os-volume_attachments/ada52826-7070-45d7-94d9-1b71d9455068" status: 202 len: 0 microversion: 2.1 time: 0.240674 May 19 21:37:58.544200 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 303/615] 10.222.0.65 () {58 vars in 1415 bytes} [Thu May 19 21:37:58 2022] DELETE /compute/v2.1/servers/e9a11702-a589-4205-9c2e-25322e44ecfe/os-volume_attachments/ada52826-7070-45d7-94d9-1b71d9455068 => generated 0 bytes in 243 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 19 21:38:00.743625 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-1a49efea-f492-4116-bc81-8ee16f24cb54 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:38:00.744217 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-1a49efea-f492-4116-bc81-8ee16f24cb54 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] [instance: e9a11702-a589-4205-9c2e-25322e44ecfe] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:38:00.746809 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=3 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:38:00.747458 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell1:SELECT=13 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:38:00.754736 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1a49efea-f492-4116-bc81-8ee16f24cb54 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:38:00.755225 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1a49efea-f492-4116-bc81-8ee16f24cb54 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:38:00.756072 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1a49efea-f492-4116-bc81-8ee16f24cb54 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:38:00.756530 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1a49efea-f492-4116-bc81-8ee16f24cb54 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:38:00.784991 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-1a49efea-f492-4116-bc81-8ee16f24cb54 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] [instance: e9a11702-a589-4205-9c2e-25322e44ecfe] Going to try to terminate instance {{(pid=124350) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 21:38:00.877161 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-1a49efea-f492-4116-bc81-8ee16f24cb54 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] 10.222.0.65 "DELETE /compute/v2.1/servers/e9a11702-a589-4205-9c2e-25322e44ecfe" status: 204 len: 0 microversion: 2.1 time: 0.137090 May 19 21:38:00.878105 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 313/616] 10.222.0.65 () {58 vars in 1238 bytes} [Thu May 19 21:38:00 2022] DELETE /compute/v2.1/servers/e9a11702-a589-4205-9c2e-25322e44ecfe => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 21:38:00.886698 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-cf89f19d-e251-4054-91c0-7b351ce07fee tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:38:00.887552 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-cf89f19d-e251-4054-91c0-7b351ce07fee tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] [instance: e9a11702-a589-4205-9c2e-25322e44ecfe] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:38:00.895900 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-cf89f19d-e251-4054-91c0-7b351ce07fee tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:38:00.896360 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-cf89f19d-e251-4054-91c0-7b351ce07fee tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:38:00.897119 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-cf89f19d-e251-4054-91c0-7b351ce07fee tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:38:00.897542 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-cf89f19d-e251-4054-91c0-7b351ce07fee tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:38:01.042881 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-cf89f19d-e251-4054-91c0-7b351ce07fee tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ad8b76baf294f91bc4c641280ab03f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '120a6c484bec4e52bc5891c927647e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:38:01.051240 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-cf89f19d-e251-4054-91c0-7b351ce07fee tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] 10.222.0.65 "GET /compute/v2.1/servers/e9a11702-a589-4205-9c2e-25322e44ecfe" status: 200 len: 1513 microversion: 2.1 time: 0.168763 May 19 21:38:01.051814 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 304/617] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:38:00 2022] GET /compute/v2.1/servers/e9a11702-a589-4205-9c2e-25322e44ecfe => generated 1513 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:38:02.070118 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-47d8fa37-ab32-4e3d-b600-9a1b50c354ce tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:38:02.070943 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-47d8fa37-ab32-4e3d-b600-9a1b50c354ce tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] [instance: e9a11702-a589-4205-9c2e-25322e44ecfe] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:38:02.078781 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-47d8fa37-ab32-4e3d-b600-9a1b50c354ce tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:38:02.079263 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-47d8fa37-ab32-4e3d-b600-9a1b50c354ce tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:38:02.080107 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-47d8fa37-ab32-4e3d-b600-9a1b50c354ce tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:38:02.080573 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-47d8fa37-ab32-4e3d-b600-9a1b50c354ce tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:38:02.220201 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-47d8fa37-ab32-4e3d-b600-9a1b50c354ce tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ad8b76baf294f91bc4c641280ab03f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '120a6c484bec4e52bc5891c927647e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:38:02.231986 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-47d8fa37-ab32-4e3d-b600-9a1b50c354ce tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] 10.222.0.65 "GET /compute/v2.1/servers/e9a11702-a589-4205-9c2e-25322e44ecfe" status: 200 len: 1513 microversion: 2.1 time: 0.166177 May 19 21:38:02.232844 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 314/618] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:38:02 2022] GET /compute/v2.1/servers/e9a11702-a589-4205-9c2e-25322e44ecfe => generated 1513 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:38:03.250370 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-91238952-bc46-4c6f-a0b7-f3c7665c7340 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:38:03.250995 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-91238952-bc46-4c6f-a0b7-f3c7665c7340 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] [instance: e9a11702-a589-4205-9c2e-25322e44ecfe] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:38:03.258223 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-91238952-bc46-4c6f-a0b7-f3c7665c7340 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:38:03.258708 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-91238952-bc46-4c6f-a0b7-f3c7665c7340 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:38:03.259474 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-91238952-bc46-4c6f-a0b7-f3c7665c7340 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:38:03.260003 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-91238952-bc46-4c6f-a0b7-f3c7665c7340 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:38:03.492004 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-91238952-bc46-4c6f-a0b7-f3c7665c7340 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ad8b76baf294f91bc4c641280ab03f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '120a6c484bec4e52bc5891c927647e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:38:03.500998 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-91238952-bc46-4c6f-a0b7-f3c7665c7340 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] 10.222.0.65 "GET /compute/v2.1/servers/e9a11702-a589-4205-9c2e-25322e44ecfe" status: 200 len: 1513 microversion: 2.1 time: 0.254679 May 19 21:38:03.501520 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 305/619] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:38:03 2022] GET /compute/v2.1/servers/e9a11702-a589-4205-9c2e-25322e44ecfe => generated 1513 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:38:03.922276 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [req-a6b3361b-650e-485a-92b6-e87653855a42 req-010ea1a3-8423-46be-8a0b-f8cc527277fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9a11702-a589-4205-9c2e-25322e44ecfe", "name": "network-vif-deleted", "tag": "bd8d518d-9ed5-430e-bea4-b9bd5b79cbbb"}]} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:38:03.930409 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-a6b3361b-650e-485a-92b6-e87653855a42 req-010ea1a3-8423-46be-8a0b-f8cc527277fc service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:38:03.930877 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-a6b3361b-650e-485a-92b6-e87653855a42 req-010ea1a3-8423-46be-8a0b-f8cc527277fc service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:38:03.943294 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.compute.server_external_events [req-a6b3361b-650e-485a-92b6-e87653855a42 req-010ea1a3-8423-46be-8a0b-f8cc527277fc service nova] Creating event network-vif-deleted:bd8d518d-9ed5-430e-bea4-b9bd5b79cbbb for instance e9a11702-a589-4205-9c2e-25322e44ecfe on hv-cinder-83563 May 19 21:38:03.948666 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [req-a6b3361b-650e-485a-92b6-e87653855a42 req-010ea1a3-8423-46be-8a0b-f8cc527277fc service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091555 May 19 21:38:03.949265 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 315/620] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 21:38:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 21:38:04.518758 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-e88ec813-1dc1-4bf5-94fe-d66585c8d369 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:38:04.519376 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-e88ec813-1dc1-4bf5-94fe-d66585c8d369 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] [instance: e9a11702-a589-4205-9c2e-25322e44ecfe] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:38:04.526898 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e88ec813-1dc1-4bf5-94fe-d66585c8d369 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:38:04.527617 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e88ec813-1dc1-4bf5-94fe-d66585c8d369 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:38:04.528706 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e88ec813-1dc1-4bf5-94fe-d66585c8d369 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:38:04.529549 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e88ec813-1dc1-4bf5-94fe-d66585c8d369 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:38:04.546331 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.wsgi [None req-e88ec813-1dc1-4bf5-94fe-d66585c8d369 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] HTTP exception thrown: Instance e9a11702-a589-4205-9c2e-25322e44ecfe could not be found. May 19 21:38:04.547909 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-e88ec813-1dc1-4bf5-94fe-d66585c8d369 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Request method failure captured: May 19 21:38:04.547909 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: request: GET /compute/v2.1/servers/e9a11702-a589-4205-9c2e-25322e44ecfe HTTP/1.1 May 19 21:38:04.547909 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Accept: application/json May 19 21:38:04.547909 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Accept-Encoding: identity May 19 21:38:04.547909 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Connection: close May 19 21:38:04.547909 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Content-Length: 0 May 19 21:38:04.547909 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Content-Type: application/json May 19 21:38:04.547909 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Host: 10.222.0.65 May 19 21:38:04.547909 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Openstack-System-Scope: None May 19 21:38:04.547909 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: User-Agent: python-urllib3/1.26.9 May 19 21:38:04.547909 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Auth-Token: gAAAAABihrgYquI9FZstsnfBTMisWYHpd3CQ4zYcWPhDIWZ4cBrM0Qo--ryZwxUU7lVO9zuUybYw-PytYrSaUvcceMvCEkcf9_FQkhPLykut92xflEhCVHIwsaebDxQ4j1Y5WLAr3qXPOuLW1twA3SYQfIZFvQe3HLvDRYoEvuKq35E5EmDskT8 May 19 21:38:04.547909 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Domain-Id: None May 19 21:38:04.547909 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Domain-Name: None May 19 21:38:04.547909 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Identity-Status: Confirmed May 19 21:38:04.547909 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Is-Admin-Project: True May 19 21:38:04.547909 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Project-Domain-Id: default May 19 21:38:04.547909 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Project-Domain-Name: Default May 19 21:38:04.547909 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Project-Id: 120a6c484bec4e52bc5891c927647e75 May 19 21:38:04.547909 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Project-Name: tempest-VolumesSnapshotTestJSON-403570519 May 19 21:38:04.547909 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Role: reader,member May 19 21:38:04.547909 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Roles: reader,member May 19 21:38:04.549405 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/120a6c484bec4e52bc5891c927647e75"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/120a6c484bec4e52bc5891c927647e75"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_120a6c484bec4e52bc5891c927647e75"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/120a6c484bec4e52bc5891c927647e75"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}] May 19 21:38:04.549405 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Tenant: tempest-VolumesSnapshotTestJSON-403570519 May 19 21:38:04.549405 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Tenant-Id: 120a6c484bec4e52bc5891c927647e75 May 19 21:38:04.549405 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-403570519 May 19 21:38:04.549405 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-User: tempest-VolumesSnapshotTestJSON-403570519-project May 19 21:38:04.549405 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-User-Domain-Id: default May 19 21:38:04.549405 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-User-Domain-Name: Default May 19 21:38:04.549405 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-User-Id: 1ad8b76baf294f91bc4c641280ab03f7 May 19 21:38:04.549405 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-User-Name: tempest-VolumesSnapshotTestJSON-403570519-project May 19 21:38:04.549405 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: method: > May 19 21:38:04.549405 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: exception: Instance e9a11702-a589-4205-9c2e-25322e44ecfe could not be found. May 19 21:38:04.549405 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: action_args: {'id': 'e9a11702-a589-4205-9c2e-25322e44ecfe'} May 19 21:38:04.550278 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 21:38:04.550278 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:38:04.550278 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 21:38:04.550278 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 21:38:04.550278 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 21:38:04.550278 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 21:38:04.550278 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 21:38:04.550278 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 21:38:04.550278 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 21:38:04.550278 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 21:38:04.550278 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9a11702-a589-4205-9c2e-25322e44ecfe could not be found. May 19 21:38:04.550278 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:38:04.550278 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 21:38:04.550278 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:38:04.550278 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:38:04.550278 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 21:38:04.550278 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 21:38:04.550278 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 21:38:04.550278 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 21:38:04.550278 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 21:38:04.551664 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 21:38:04.551664 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 21:38:04.551664 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 21:38:04.551664 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 21:38:04.551664 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 21:38:04.551664 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 21:38:04.551664 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 21:38:04.551664 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9a11702-a589-4205-9c2e-25322e44ecfe could not be found. May 19 21:38:04.551664 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:38:04.551664 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 21:38:04.551664 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:38:04.551664 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:38:04.551664 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 21:38:04.551664 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 21:38:04.551664 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 21:38:04.551664 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 21:38:04.551664 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9a11702-a589-4205-9c2e-25322e44ecfe could not be found. May 19 21:38:04.551664 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:38:04.552958 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-e88ec813-1dc1-4bf5-94fe-d66585c8d369 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] Returning 404 to user: Instance e9a11702-a589-4205-9c2e-25322e44ecfe could not be found. {{(pid=124349) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 21:38:04.552958 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-e88ec813-1dc1-4bf5-94fe-d66585c8d369 tempest-VolumesSnapshotTestJSON-403570519 tempest-VolumesSnapshotTestJSON-403570519-project] 10.222.0.65 "GET /compute/v2.1/servers/e9a11702-a589-4205-9c2e-25322e44ecfe" status: 404 len: 111 microversion: 2.1 time: 0.034887 May 19 21:38:04.552958 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 306/621] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:38:04 2022] GET /compute/v2.1/servers/e9a11702-a589-4205-9c2e-25322e44ecfe => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 21:38:06.056107 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-6765f6d8-1ced-40df-bf80-01e96a231f7d tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6d6a13c0-0bd8-4fb7-9e87-9f7559e75282"}} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:38:06.057273 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-6765f6d8-1ced-40df-bf80-01e96a231f7d tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: e51de034-1fec-4513-a375-6b28e6180d82] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:38:06.064883 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6765f6d8-1ced-40df-bf80-01e96a231f7d tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:38:06.065336 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6765f6d8-1ced-40df-bf80-01e96a231f7d tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:38:06.066208 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6765f6d8-1ced-40df-bf80-01e96a231f7d tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:38:06.066687 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6765f6d8-1ced-40df-bf80-01e96a231f7d tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:38:06.346595 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-6765f6d8-1ced-40df-bf80-01e96a231f7d tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "POST /compute/v2.1/servers/e51de034-1fec-4513-a375-6b28e6180d82/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.409172 May 19 21:38:06.347478 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 316/622] 10.222.0.65 () {60 vars in 1322 bytes} [Thu May 19 21:38:05 2022] POST /compute/v2.1/servers/e51de034-1fec-4513-a375-6b28e6180d82/os-volume_attachments => generated 194 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 21:38:22.409399 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-7a4c88ad-7d71-49fe-bd05-886731276581 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:38:22.410592 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-7a4c88ad-7d71-49fe-bd05-886731276581 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: e51de034-1fec-4513-a375-6b28e6180d82] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:38:22.413015 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_api:SELECT=8 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:38:22.413660 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_cell1:SELECT=23,nova_cell1:INSERT=1 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:38:22.422681 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-7a4c88ad-7d71-49fe-bd05-886731276581 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:38:22.423467 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-7a4c88ad-7d71-49fe-bd05-886731276581 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:38:22.424343 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-7a4c88ad-7d71-49fe-bd05-886731276581 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:38:22.424898 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-7a4c88ad-7d71-49fe-bd05-886731276581 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:38:22.457649 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.objects.instance [None req-7a4c88ad-7d71-49fe-bd05-886731276581 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lazy-loading 'flavor' on Instance uuid e51de034-1fec-4513-a375-6b28e6180d82 {{(pid=124349) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 21:38:22.617159 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-7a4c88ad-7d71-49fe-bd05-886731276581 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "POST /compute/v2.1/servers/e51de034-1fec-4513-a375-6b28e6180d82/action" status: 200 len: 32 microversion: 2.1 time: 0.213422 May 19 21:38:22.618160 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 307/623] 10.222.0.65 () {60 vars in 1277 bytes} [Thu May 19 21:38:22 2022] POST /compute/v2.1/servers/e51de034-1fec-4513-a375-6b28e6180d82/action => generated 32 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 21:38:22.628501 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-5a631de1-cc0e-4cfe-b4e3-092ab3bee25a tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:38:22.629210 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-5a631de1-cc0e-4cfe-b4e3-092ab3bee25a tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: e51de034-1fec-4513-a375-6b28e6180d82] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:38:22.631884 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:38:22.632581 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell1:SELECT=33,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:38:22.640576 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5a631de1-cc0e-4cfe-b4e3-092ab3bee25a tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:38:22.641004 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5a631de1-cc0e-4cfe-b4e3-092ab3bee25a tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:38:22.642012 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5a631de1-cc0e-4cfe-b4e3-092ab3bee25a tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:38:22.642812 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5a631de1-cc0e-4cfe-b4e3-092ab3bee25a tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:38:22.807787 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-5a631de1-cc0e-4cfe-b4e3-092ab3bee25a tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1589968f375946a38e82ec484afc837f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c62c1f3c54f568abdac37360ab457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:38:22.816738 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-5a631de1-cc0e-4cfe-b4e3-092ab3bee25a tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "GET /compute/v2.1/servers/e51de034-1fec-4513-a375-6b28e6180d82" status: 200 len: 1735 microversion: 2.1 time: 0.192708 May 19 21:38:22.817319 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 317/624] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:38:22 2022] GET /compute/v2.1/servers/e51de034-1fec-4513-a375-6b28e6180d82 => generated 1735 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:38:23.840980 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-5a80412d-0ff6-4478-883e-c59960daa239 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:38:23.841861 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-5a80412d-0ff6-4478-883e-c59960daa239 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: e51de034-1fec-4513-a375-6b28e6180d82] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:38:23.849609 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-5a80412d-0ff6-4478-883e-c59960daa239 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:38:23.850047 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-5a80412d-0ff6-4478-883e-c59960daa239 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:38:23.850851 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-5a80412d-0ff6-4478-883e-c59960daa239 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:38:23.851309 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-5a80412d-0ff6-4478-883e-c59960daa239 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:38:24.004668 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-5a80412d-0ff6-4478-883e-c59960daa239 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1589968f375946a38e82ec484afc837f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c62c1f3c54f568abdac37360ab457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:38:24.013424 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-5a80412d-0ff6-4478-883e-c59960daa239 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "GET /compute/v2.1/servers/e51de034-1fec-4513-a375-6b28e6180d82" status: 200 len: 1735 microversion: 2.1 time: 0.177215 May 19 21:38:24.013988 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 308/625] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:38:23 2022] GET /compute/v2.1/servers/e51de034-1fec-4513-a375-6b28e6180d82 => generated 1735 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:38:25.031693 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-a53624fb-d2f1-4fb6-9e8d-dd3a71674929 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:38:25.032262 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-a53624fb-d2f1-4fb6-9e8d-dd3a71674929 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: e51de034-1fec-4513-a375-6b28e6180d82] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:38:25.045656 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a53624fb-d2f1-4fb6-9e8d-dd3a71674929 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:38:25.046108 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a53624fb-d2f1-4fb6-9e8d-dd3a71674929 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:38:25.047168 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a53624fb-d2f1-4fb6-9e8d-dd3a71674929 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:38:25.047640 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a53624fb-d2f1-4fb6-9e8d-dd3a71674929 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:38:25.185178 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-a53624fb-d2f1-4fb6-9e8d-dd3a71674929 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1589968f375946a38e82ec484afc837f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c62c1f3c54f568abdac37360ab457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:38:25.195720 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-a53624fb-d2f1-4fb6-9e8d-dd3a71674929 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "GET /compute/v2.1/servers/e51de034-1fec-4513-a375-6b28e6180d82" status: 200 len: 1735 microversion: 2.1 time: 0.168157 May 19 21:38:25.196492 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 318/626] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:38:25 2022] GET /compute/v2.1/servers/e51de034-1fec-4513-a375-6b28e6180d82 => generated 1735 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:38:26.213953 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-73402039-1069-4cb5-a865-dab26abac6a4 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:38:26.214586 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-73402039-1069-4cb5-a865-dab26abac6a4 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: e51de034-1fec-4513-a375-6b28e6180d82] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:38:26.221815 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-73402039-1069-4cb5-a865-dab26abac6a4 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:38:26.222282 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-73402039-1069-4cb5-a865-dab26abac6a4 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:38:26.223070 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-73402039-1069-4cb5-a865-dab26abac6a4 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:38:26.223510 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-73402039-1069-4cb5-a865-dab26abac6a4 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:38:26.372913 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-73402039-1069-4cb5-a865-dab26abac6a4 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1589968f375946a38e82ec484afc837f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c62c1f3c54f568abdac37360ab457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:38:26.385823 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-73402039-1069-4cb5-a865-dab26abac6a4 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "GET /compute/v2.1/servers/e51de034-1fec-4513-a375-6b28e6180d82" status: 200 len: 1735 microversion: 2.1 time: 0.175520 May 19 21:38:26.386686 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 309/627] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:38:26 2022] GET /compute/v2.1/servers/e51de034-1fec-4513-a375-6b28e6180d82 => generated 1735 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:38:27.405921 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-142e08f7-adda-44bc-a050-b6a9c6b61f24 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:38:27.406545 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-142e08f7-adda-44bc-a050-b6a9c6b61f24 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: e51de034-1fec-4513-a375-6b28e6180d82] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:38:27.414874 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-142e08f7-adda-44bc-a050-b6a9c6b61f24 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:38:27.415313 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-142e08f7-adda-44bc-a050-b6a9c6b61f24 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:38:27.416134 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-142e08f7-adda-44bc-a050-b6a9c6b61f24 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:38:27.416566 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-142e08f7-adda-44bc-a050-b6a9c6b61f24 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:38:27.555670 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-142e08f7-adda-44bc-a050-b6a9c6b61f24 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1589968f375946a38e82ec484afc837f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c62c1f3c54f568abdac37360ab457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:38:27.564419 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-142e08f7-adda-44bc-a050-b6a9c6b61f24 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "GET /compute/v2.1/servers/e51de034-1fec-4513-a375-6b28e6180d82" status: 200 len: 1735 microversion: 2.1 time: 0.163744 May 19 21:38:27.564992 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 319/628] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:38:27 2022] GET /compute/v2.1/servers/e51de034-1fec-4513-a375-6b28e6180d82 => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:38:28.581986 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-bc083870-6de7-4c04-9873-5dfca5b55e7a tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:38:28.582638 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-bc083870-6de7-4c04-9873-5dfca5b55e7a tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: e51de034-1fec-4513-a375-6b28e6180d82] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:38:28.589531 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-bc083870-6de7-4c04-9873-5dfca5b55e7a tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:38:28.590008 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-bc083870-6de7-4c04-9873-5dfca5b55e7a tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:38:28.590807 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-bc083870-6de7-4c04-9873-5dfca5b55e7a tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:38:28.591432 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-bc083870-6de7-4c04-9873-5dfca5b55e7a tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:38:28.745668 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-bc083870-6de7-4c04-9873-5dfca5b55e7a tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1589968f375946a38e82ec484afc837f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c62c1f3c54f568abdac37360ab457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:38:28.757736 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-bc083870-6de7-4c04-9873-5dfca5b55e7a tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "GET /compute/v2.1/servers/e51de034-1fec-4513-a375-6b28e6180d82" status: 200 len: 1735 microversion: 2.1 time: 0.179343 May 19 21:38:28.758600 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 310/629] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:38:28 2022] GET /compute/v2.1/servers/e51de034-1fec-4513-a375-6b28e6180d82 => generated 1735 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:38:29.777555 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-4a0ff9a2-7825-4904-a1d1-672bcc1e0f6b tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:38:29.778212 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-4a0ff9a2-7825-4904-a1d1-672bcc1e0f6b tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: e51de034-1fec-4513-a375-6b28e6180d82] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:38:29.785372 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4a0ff9a2-7825-4904-a1d1-672bcc1e0f6b tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:38:29.785816 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4a0ff9a2-7825-4904-a1d1-672bcc1e0f6b tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:38:29.786743 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4a0ff9a2-7825-4904-a1d1-672bcc1e0f6b tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:38:29.787184 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4a0ff9a2-7825-4904-a1d1-672bcc1e0f6b tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:38:29.933458 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-4a0ff9a2-7825-4904-a1d1-672bcc1e0f6b tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1589968f375946a38e82ec484afc837f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c62c1f3c54f568abdac37360ab457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:38:29.945413 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-4a0ff9a2-7825-4904-a1d1-672bcc1e0f6b tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "GET /compute/v2.1/servers/e51de034-1fec-4513-a375-6b28e6180d82" status: 200 len: 1735 microversion: 2.1 time: 0.171608 May 19 21:38:29.946216 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 320/630] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:38:29 2022] GET /compute/v2.1/servers/e51de034-1fec-4513-a375-6b28e6180d82 => generated 1735 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:38:30.963230 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-1ad10c2a-54f5-450a-8800-57d2492ddd35 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:38:30.963884 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-1ad10c2a-54f5-450a-8800-57d2492ddd35 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: e51de034-1fec-4513-a375-6b28e6180d82] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:38:30.970997 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1ad10c2a-54f5-450a-8800-57d2492ddd35 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:38:30.971448 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1ad10c2a-54f5-450a-8800-57d2492ddd35 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:38:30.972219 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1ad10c2a-54f5-450a-8800-57d2492ddd35 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:38:30.972655 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1ad10c2a-54f5-450a-8800-57d2492ddd35 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:38:31.121849 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-1ad10c2a-54f5-450a-8800-57d2492ddd35 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1589968f375946a38e82ec484afc837f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c62c1f3c54f568abdac37360ab457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:38:31.131244 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-1ad10c2a-54f5-450a-8800-57d2492ddd35 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "GET /compute/v2.1/servers/e51de034-1fec-4513-a375-6b28e6180d82" status: 200 len: 1735 microversion: 2.1 time: 0.171837 May 19 21:38:31.131825 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 311/631] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:38:30 2022] GET /compute/v2.1/servers/e51de034-1fec-4513-a375-6b28e6180d82 => generated 1735 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:38:32.149071 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-aacab1fb-4c3b-4ddb-8517-5a1c4298547e tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:38:32.150001 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-aacab1fb-4c3b-4ddb-8517-5a1c4298547e tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: e51de034-1fec-4513-a375-6b28e6180d82] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:38:32.157325 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-aacab1fb-4c3b-4ddb-8517-5a1c4298547e tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:38:32.157763 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-aacab1fb-4c3b-4ddb-8517-5a1c4298547e tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:38:32.158550 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-aacab1fb-4c3b-4ddb-8517-5a1c4298547e tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:38:32.158976 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-aacab1fb-4c3b-4ddb-8517-5a1c4298547e tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:38:32.297968 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-aacab1fb-4c3b-4ddb-8517-5a1c4298547e tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1589968f375946a38e82ec484afc837f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c62c1f3c54f568abdac37360ab457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:38:32.305968 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-aacab1fb-4c3b-4ddb-8517-5a1c4298547e tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "GET /compute/v2.1/servers/e51de034-1fec-4513-a375-6b28e6180d82" status: 200 len: 1735 microversion: 2.1 time: 0.160853 May 19 21:38:32.306561 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 321/632] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:38:32 2022] GET /compute/v2.1/servers/e51de034-1fec-4513-a375-6b28e6180d82 => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:38:33.324370 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-0f303659-2057-4e06-b678-cc04314df47a tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:38:33.325084 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-0f303659-2057-4e06-b678-cc04314df47a tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: e51de034-1fec-4513-a375-6b28e6180d82] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:38:33.332342 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-0f303659-2057-4e06-b678-cc04314df47a tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:38:33.333108 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-0f303659-2057-4e06-b678-cc04314df47a tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:38:33.333891 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-0f303659-2057-4e06-b678-cc04314df47a tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:38:33.334344 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-0f303659-2057-4e06-b678-cc04314df47a tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:38:33.479682 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-0f303659-2057-4e06-b678-cc04314df47a tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1589968f375946a38e82ec484afc837f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c62c1f3c54f568abdac37360ab457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:38:33.488916 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-0f303659-2057-4e06-b678-cc04314df47a tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "GET /compute/v2.1/servers/e51de034-1fec-4513-a375-6b28e6180d82" status: 200 len: 1735 microversion: 2.1 time: 0.168392 May 19 21:38:33.489490 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 312/633] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:38:33 2022] GET /compute/v2.1/servers/e51de034-1fec-4513-a375-6b28e6180d82 => generated 1735 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:38:34.507715 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-7d1059ac-bcc7-4d0b-a244-41bcdf58fcdc tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:38:34.508340 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-7d1059ac-bcc7-4d0b-a244-41bcdf58fcdc tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: e51de034-1fec-4513-a375-6b28e6180d82] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:38:34.515907 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7d1059ac-bcc7-4d0b-a244-41bcdf58fcdc tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:38:34.516358 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7d1059ac-bcc7-4d0b-a244-41bcdf58fcdc tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:38:34.517108 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7d1059ac-bcc7-4d0b-a244-41bcdf58fcdc tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:38:34.517539 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7d1059ac-bcc7-4d0b-a244-41bcdf58fcdc tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:38:34.665949 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-7d1059ac-bcc7-4d0b-a244-41bcdf58fcdc tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1589968f375946a38e82ec484afc837f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c62c1f3c54f568abdac37360ab457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:38:34.675500 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-7d1059ac-bcc7-4d0b-a244-41bcdf58fcdc tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "GET /compute/v2.1/servers/e51de034-1fec-4513-a375-6b28e6180d82" status: 200 len: 1735 microversion: 2.1 time: 0.171762 May 19 21:38:34.676074 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 322/634] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:38:34 2022] GET /compute/v2.1/servers/e51de034-1fec-4513-a375-6b28e6180d82 => generated 1735 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:38:35.693252 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-ce6e76f7-8588-4d11-90a5-27cb6deb6bdd tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:38:35.693862 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-ce6e76f7-8588-4d11-90a5-27cb6deb6bdd tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: e51de034-1fec-4513-a375-6b28e6180d82] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:38:35.701285 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ce6e76f7-8588-4d11-90a5-27cb6deb6bdd tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:38:35.701718 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ce6e76f7-8588-4d11-90a5-27cb6deb6bdd tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:38:35.703323 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ce6e76f7-8588-4d11-90a5-27cb6deb6bdd tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:38:35.703776 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ce6e76f7-8588-4d11-90a5-27cb6deb6bdd tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:38:35.848132 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-ce6e76f7-8588-4d11-90a5-27cb6deb6bdd tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1589968f375946a38e82ec484afc837f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c62c1f3c54f568abdac37360ab457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:38:35.856319 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-ce6e76f7-8588-4d11-90a5-27cb6deb6bdd tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "GET /compute/v2.1/servers/e51de034-1fec-4513-a375-6b28e6180d82" status: 200 len: 1735 microversion: 2.1 time: 0.166972 May 19 21:38:35.857667 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 313/635] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:38:35 2022] GET /compute/v2.1/servers/e51de034-1fec-4513-a375-6b28e6180d82 => generated 1735 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:38:36.878273 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-27d673f7-e89c-4d08-b465-9356b504f6ce tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:38:36.879089 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-27d673f7-e89c-4d08-b465-9356b504f6ce tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: e51de034-1fec-4513-a375-6b28e6180d82] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:38:36.888786 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-27d673f7-e89c-4d08-b465-9356b504f6ce tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:38:36.889224 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-27d673f7-e89c-4d08-b465-9356b504f6ce tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:38:36.889976 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-27d673f7-e89c-4d08-b465-9356b504f6ce tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:38:36.890442 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-27d673f7-e89c-4d08-b465-9356b504f6ce tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:38:37.037652 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-27d673f7-e89c-4d08-b465-9356b504f6ce tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1589968f375946a38e82ec484afc837f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c62c1f3c54f568abdac37360ab457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:38:37.046335 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-27d673f7-e89c-4d08-b465-9356b504f6ce tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "GET /compute/v2.1/servers/e51de034-1fec-4513-a375-6b28e6180d82" status: 200 len: 1735 microversion: 2.1 time: 0.174318 May 19 21:38:37.047117 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 323/636] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:38:36 2022] GET /compute/v2.1/servers/e51de034-1fec-4513-a375-6b28e6180d82 => generated 1735 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:38:38.064527 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-35f14f3b-aac0-44cb-b327-41cf7e000f36 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:38:38.065145 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-35f14f3b-aac0-44cb-b327-41cf7e000f36 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: e51de034-1fec-4513-a375-6b28e6180d82] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:38:38.072074 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-35f14f3b-aac0-44cb-b327-41cf7e000f36 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:38:38.072523 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-35f14f3b-aac0-44cb-b327-41cf7e000f36 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:38:38.073294 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-35f14f3b-aac0-44cb-b327-41cf7e000f36 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:38:38.073726 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-35f14f3b-aac0-44cb-b327-41cf7e000f36 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:38:38.220780 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-35f14f3b-aac0-44cb-b327-41cf7e000f36 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1589968f375946a38e82ec484afc837f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c62c1f3c54f568abdac37360ab457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:38:38.229184 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-35f14f3b-aac0-44cb-b327-41cf7e000f36 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "GET /compute/v2.1/servers/e51de034-1fec-4513-a375-6b28e6180d82" status: 200 len: 1735 microversion: 2.1 time: 0.168732 May 19 21:38:38.229747 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 314/637] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:38:38 2022] GET /compute/v2.1/servers/e51de034-1fec-4513-a375-6b28e6180d82 => generated 1735 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:38:39.247002 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-e3194ecb-1ee9-4be4-95d8-87d4850f38f4 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:38:39.247795 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-e3194ecb-1ee9-4be4-95d8-87d4850f38f4 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: e51de034-1fec-4513-a375-6b28e6180d82] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:38:39.254650 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e3194ecb-1ee9-4be4-95d8-87d4850f38f4 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:38:39.255083 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e3194ecb-1ee9-4be4-95d8-87d4850f38f4 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:38:39.255843 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e3194ecb-1ee9-4be4-95d8-87d4850f38f4 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:38:39.256265 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e3194ecb-1ee9-4be4-95d8-87d4850f38f4 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:38:39.398610 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-e3194ecb-1ee9-4be4-95d8-87d4850f38f4 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1589968f375946a38e82ec484afc837f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c62c1f3c54f568abdac37360ab457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:38:39.407579 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-e3194ecb-1ee9-4be4-95d8-87d4850f38f4 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "GET /compute/v2.1/servers/e51de034-1fec-4513-a375-6b28e6180d82" status: 200 len: 1735 microversion: 2.1 time: 0.164552 May 19 21:38:39.408155 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 324/638] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:38:39 2022] GET /compute/v2.1/servers/e51de034-1fec-4513-a375-6b28e6180d82 => generated 1735 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 21:38:40.425925 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-bb8dfd7c-fd92-4e67-8a17-1f4c17fd31b8 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:38:40.426605 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-bb8dfd7c-fd92-4e67-8a17-1f4c17fd31b8 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: e51de034-1fec-4513-a375-6b28e6180d82] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:38:40.433794 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-bb8dfd7c-fd92-4e67-8a17-1f4c17fd31b8 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:38:40.434234 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-bb8dfd7c-fd92-4e67-8a17-1f4c17fd31b8 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:38:40.435067 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-bb8dfd7c-fd92-4e67-8a17-1f4c17fd31b8 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:38:40.435507 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-bb8dfd7c-fd92-4e67-8a17-1f4c17fd31b8 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:38:40.593526 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-bb8dfd7c-fd92-4e67-8a17-1f4c17fd31b8 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1589968f375946a38e82ec484afc837f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c62c1f3c54f568abdac37360ab457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:38:40.602908 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-bb8dfd7c-fd92-4e67-8a17-1f4c17fd31b8 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "GET /compute/v2.1/servers/e51de034-1fec-4513-a375-6b28e6180d82" status: 200 len: 1735 microversion: 2.1 time: 0.181012 May 19 21:38:40.603493 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 315/639] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:38:40 2022] GET /compute/v2.1/servers/e51de034-1fec-4513-a375-6b28e6180d82 => generated 1735 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:38:41.621683 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-78e2b33d-80ca-4ac4-ab87-0737efe4f2d5 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:38:41.622704 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-78e2b33d-80ca-4ac4-ab87-0737efe4f2d5 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: e51de034-1fec-4513-a375-6b28e6180d82] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:38:41.630734 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-78e2b33d-80ca-4ac4-ab87-0737efe4f2d5 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:38:41.631182 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-78e2b33d-80ca-4ac4-ab87-0737efe4f2d5 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:38:41.631978 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-78e2b33d-80ca-4ac4-ab87-0737efe4f2d5 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:38:41.632436 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-78e2b33d-80ca-4ac4-ab87-0737efe4f2d5 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:38:41.787085 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-78e2b33d-80ca-4ac4-ab87-0737efe4f2d5 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1589968f375946a38e82ec484afc837f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c62c1f3c54f568abdac37360ab457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:38:41.795939 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-78e2b33d-80ca-4ac4-ab87-0737efe4f2d5 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "GET /compute/v2.1/servers/e51de034-1fec-4513-a375-6b28e6180d82" status: 200 len: 1735 microversion: 2.1 time: 0.178152 May 19 21:38:41.796582 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 325/640] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:38:41 2022] GET /compute/v2.1/servers/e51de034-1fec-4513-a375-6b28e6180d82 => generated 1735 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:38:42.817128 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-783bfad5-5249-4972-ac77-3f3768d73f4b tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:38:42.818187 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-783bfad5-5249-4972-ac77-3f3768d73f4b tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: e51de034-1fec-4513-a375-6b28e6180d82] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:38:42.826219 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-783bfad5-5249-4972-ac77-3f3768d73f4b tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:38:42.826682 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-783bfad5-5249-4972-ac77-3f3768d73f4b tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:38:42.827483 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-783bfad5-5249-4972-ac77-3f3768d73f4b tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:38:42.827942 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-783bfad5-5249-4972-ac77-3f3768d73f4b tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:38:42.973557 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-783bfad5-5249-4972-ac77-3f3768d73f4b tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1589968f375946a38e82ec484afc837f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c62c1f3c54f568abdac37360ab457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:38:42.988657 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-783bfad5-5249-4972-ac77-3f3768d73f4b tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "GET /compute/v2.1/servers/e51de034-1fec-4513-a375-6b28e6180d82" status: 200 len: 1715 microversion: 2.1 time: 0.178111 May 19 21:38:42.989713 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 316/641] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:38:42 2022] GET /compute/v2.1/servers/e51de034-1fec-4513-a375-6b28e6180d82 => generated 1715 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:38:43.122704 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-a9afc856-fdb0-4f4c-aece-103af7cedff1 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:38:43.123640 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-a9afc856-fdb0-4f4c-aece-103af7cedff1 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: e51de034-1fec-4513-a375-6b28e6180d82] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:38:43.131500 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a9afc856-fdb0-4f4c-aece-103af7cedff1 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:38:43.132081 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a9afc856-fdb0-4f4c-aece-103af7cedff1 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:38:43.132956 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a9afc856-fdb0-4f4c-aece-103af7cedff1 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:38:43.133475 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a9afc856-fdb0-4f4c-aece-103af7cedff1 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:38:43.281652 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.wsgi [None req-a9afc856-fdb0-4f4c-aece-103af7cedff1 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] HTTP exception thrown: Cannot 'detach_volume' instance e51de034-1fec-4513-a375-6b28e6180d82 while it is in vm_state rescued May 19 21:38:43.283356 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-a9afc856-fdb0-4f4c-aece-103af7cedff1 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Request method failure captured: May 19 21:38:43.283356 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: request: DELETE /compute/v2.1/servers/e51de034-1fec-4513-a375-6b28e6180d82/os-volume_attachments/6d6a13c0-0bd8-4fb7-9e87-9f7559e75282 HTTP/1.1 May 19 21:38:43.283356 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Accept: application/json May 19 21:38:43.283356 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Accept-Encoding: identity May 19 21:38:43.283356 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Connection: close May 19 21:38:43.283356 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Content-Length: 0 May 19 21:38:43.283356 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Content-Type: application/json May 19 21:38:43.283356 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Host: 10.222.0.65 May 19 21:38:43.283356 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Openstack-System-Scope: None May 19 21:38:43.283356 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: User-Agent: python-urllib3/1.26.9 May 19 21:38:43.283356 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Auth-Token: gAAAAABihrdiO8WlYaDIi7If9wZxpwSGzpo12IIIWNH6BfJt71nk5vcpOYqFB3VPd06TTglmiGbN4sYDeZcKhy-4mKZalpEB_LLIlrgRhEAAwCx0bHylpvZxTT7OZ_q99On0cqILTOHkFkDE0bep6C1Ese4EHQeGGDI-xr78VggcJ9wPIAfjlIA May 19 21:38:43.283356 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Domain-Id: None May 19 21:38:43.283356 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Domain-Name: None May 19 21:38:43.283356 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Identity-Status: Confirmed May 19 21:38:43.283356 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Is-Admin-Project: True May 19 21:38:43.283356 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Project-Domain-Id: default May 19 21:38:43.283356 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Project-Domain-Name: Default May 19 21:38:43.283356 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Project-Id: 985c62c1f3c54f568abdac37360ab457 May 19 21:38:43.283356 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-338234618 May 19 21:38:43.283356 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Role: reader,member May 19 21:38:43.283356 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Roles: reader,member May 19 21:38:43.284918 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/985c62c1f3c54f568abdac37360ab457"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/985c62c1f3c54f568abdac37360ab457"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_985c62c1f3c54f568abdac37360ab457"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/985c62c1f3c54f568abdac37360ab457"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}] May 19 21:38:43.284918 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Tenant: tempest-ServerRescueNegativeTestJSON-338234618 May 19 21:38:43.284918 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Tenant-Id: 985c62c1f3c54f568abdac37360ab457 May 19 21:38:43.284918 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-338234618 May 19 21:38:43.284918 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-User: tempest-ServerRescueNegativeTestJSON-338234618-project May 19 21:38:43.284918 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-User-Domain-Id: default May 19 21:38:43.284918 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-User-Domain-Name: Default May 19 21:38:43.284918 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-User-Id: 1589968f375946a38e82ec484afc837f May 19 21:38:43.284918 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-User-Name: tempest-ServerRescueNegativeTestJSON-338234618-project May 19 21:38:43.284918 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: method: > May 19 21:38:43.284918 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: exception: Cannot 'detach_volume' instance e51de034-1fec-4513-a375-6b28e6180d82 while it is in vm_state rescued May 19 21:38:43.285752 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: action_args: {'server_id': 'e51de034-1fec-4513-a375-6b28e6180d82', 'id': '6d6a13c0-0bd8-4fb7-9e87-9f7559e75282'} May 19 21:38:43.285752 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 21:38:43.285752 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:38:43.285752 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 19 21:38:43.285752 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 19 21:38:43.285752 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 19 21:38:43.285752 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 19 21:38:43.285752 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 19 21:38:43.285752 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 19 21:38:43.285752 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e51de034-1fec-4513-a375-6b28e6180d82 in vm_state rescued. Cannot detach_volume while the instance is in this state. May 19 21:38:43.285752 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi May 19 21:38:43.285752 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 21:38:43.285752 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi May 19 21:38:43.285752 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:38:43.285752 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 21:38:43.285752 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 21:38:43.285752 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 21:38:43.285752 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 21:38:43.285752 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 21:38:43.285752 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 21:38:43.287255 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete May 19 21:38:43.287255 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 19 21:38:43.287255 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 19 21:38:43.287255 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 19 21:38:43.287255 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance e51de034-1fec-4513-a375-6b28e6180d82 while it is in vm_state rescued May 19 21:38:43.287255 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi May 19 21:38:43.287255 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 21:38:43.287255 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi May 19 21:38:43.287255 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:38:43.287255 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 21:38:43.287255 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 21:38:43.287255 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 21:38:43.287255 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 21:38:43.287255 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance e51de034-1fec-4513-a375-6b28e6180d82 while it is in vm_state rescued May 19 21:38:43.287255 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi May 19 21:38:43.287255 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-a9afc856-fdb0-4f4c-aece-103af7cedff1 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Returning 409 to user: Cannot 'detach_volume' instance e51de034-1fec-4513-a375-6b28e6180d82 while it is in vm_state rescued {{(pid=124350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 21:38:43.288438 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-a9afc856-fdb0-4f4c-aece-103af7cedff1 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "DELETE /compute/v2.1/servers/e51de034-1fec-4513-a375-6b28e6180d82/os-volume_attachments/6d6a13c0-0bd8-4fb7-9e87-9f7559e75282" status: 409 len: 152 microversion: 2.1 time: 0.166555 May 19 21:38:43.288438 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 326/642] 10.222.0.65 () {58 vars in 1415 bytes} [Thu May 19 21:38:43 2022] DELETE /compute/v2.1/servers/e51de034-1fec-4513-a375-6b28e6180d82/os-volume_attachments/6d6a13c0-0bd8-4fb7-9e87-9f7559e75282 => generated 152 bytes in 168 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 19 21:38:43.294280 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-5d06b3d6-572e-405a-afbd-5ab19626e732 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:38:43.295492 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-5d06b3d6-572e-405a-afbd-5ab19626e732 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: e51de034-1fec-4513-a375-6b28e6180d82] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:38:43.302476 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-5d06b3d6-572e-405a-afbd-5ab19626e732 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:38:43.302914 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-5d06b3d6-572e-405a-afbd-5ab19626e732 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:38:43.303721 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-5d06b3d6-572e-405a-afbd-5ab19626e732 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:38:43.304128 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-5d06b3d6-572e-405a-afbd-5ab19626e732 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:38:43.391802 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-5d06b3d6-572e-405a-afbd-5ab19626e732 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "POST /compute/v2.1/servers/e51de034-1fec-4513-a375-6b28e6180d82/action" status: 202 len: 0 microversion: 2.1 time: 0.101447 May 19 21:38:43.395664 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 317/643] 10.222.0.65 () {60 vars in 1277 bytes} [Thu May 19 21:38:43 2022] POST /compute/v2.1/servers/e51de034-1fec-4513-a375-6b28e6180d82/action => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 21:38:43.400775 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-e8461328-6898-449f-84dc-9f98bc3ac8c0 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:38:43.401385 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-e8461328-6898-449f-84dc-9f98bc3ac8c0 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: e51de034-1fec-4513-a375-6b28e6180d82] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:38:43.410811 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e8461328-6898-449f-84dc-9f98bc3ac8c0 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:38:43.411624 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e8461328-6898-449f-84dc-9f98bc3ac8c0 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:38:43.412862 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e8461328-6898-449f-84dc-9f98bc3ac8c0 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:38:43.413551 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e8461328-6898-449f-84dc-9f98bc3ac8c0 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:38:43.586047 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-e8461328-6898-449f-84dc-9f98bc3ac8c0 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1589968f375946a38e82ec484afc837f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c62c1f3c54f568abdac37360ab457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:38:43.595959 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-e8461328-6898-449f-84dc-9f98bc3ac8c0 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "GET /compute/v2.1/servers/e51de034-1fec-4513-a375-6b28e6180d82" status: 200 len: 1723 microversion: 2.1 time: 0.198949 May 19 21:38:43.596530 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 327/644] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:38:43 2022] GET /compute/v2.1/servers/e51de034-1fec-4513-a375-6b28e6180d82 => generated 1723 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:38:44.617480 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-4a88ea6a-0145-446c-a9df-00bc76617a82 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:38:44.618216 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-4a88ea6a-0145-446c-a9df-00bc76617a82 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: e51de034-1fec-4513-a375-6b28e6180d82] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:38:44.625505 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-4a88ea6a-0145-446c-a9df-00bc76617a82 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:38:44.625941 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-4a88ea6a-0145-446c-a9df-00bc76617a82 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:38:44.626786 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-4a88ea6a-0145-446c-a9df-00bc76617a82 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:38:44.627242 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-4a88ea6a-0145-446c-a9df-00bc76617a82 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:38:44.780476 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-4a88ea6a-0145-446c-a9df-00bc76617a82 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1589968f375946a38e82ec484afc837f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c62c1f3c54f568abdac37360ab457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:38:44.789013 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-4a88ea6a-0145-446c-a9df-00bc76617a82 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "GET /compute/v2.1/servers/e51de034-1fec-4513-a375-6b28e6180d82" status: 200 len: 1723 microversion: 2.1 time: 0.176832 May 19 21:38:44.789586 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 318/645] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:38:44 2022] GET /compute/v2.1/servers/e51de034-1fec-4513-a375-6b28e6180d82 => generated 1723 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:38:45.807675 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-69ceac36-5eca-4b76-91eb-13ff6d161250 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:38:45.808276 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-69ceac36-5eca-4b76-91eb-13ff6d161250 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: e51de034-1fec-4513-a375-6b28e6180d82] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:38:45.815861 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-69ceac36-5eca-4b76-91eb-13ff6d161250 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:38:45.816305 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-69ceac36-5eca-4b76-91eb-13ff6d161250 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:38:45.817087 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-69ceac36-5eca-4b76-91eb-13ff6d161250 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:38:45.817518 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-69ceac36-5eca-4b76-91eb-13ff6d161250 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:38:45.964902 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-69ceac36-5eca-4b76-91eb-13ff6d161250 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1589968f375946a38e82ec484afc837f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c62c1f3c54f568abdac37360ab457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:38:45.974281 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-69ceac36-5eca-4b76-91eb-13ff6d161250 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "GET /compute/v2.1/servers/e51de034-1fec-4513-a375-6b28e6180d82" status: 200 len: 1723 microversion: 2.1 time: 0.170405 May 19 21:38:45.974892 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 328/646] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:38:45 2022] GET /compute/v2.1/servers/e51de034-1fec-4513-a375-6b28e6180d82 => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:38:46.994858 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-32df9be8-7c8b-4e7d-af87-71c2a1b218bf tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:38:46.995865 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-32df9be8-7c8b-4e7d-af87-71c2a1b218bf tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: e51de034-1fec-4513-a375-6b28e6180d82] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:38:47.003036 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-32df9be8-7c8b-4e7d-af87-71c2a1b218bf tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:38:47.003506 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-32df9be8-7c8b-4e7d-af87-71c2a1b218bf tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:38:47.004270 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-32df9be8-7c8b-4e7d-af87-71c2a1b218bf tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:38:47.004711 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-32df9be8-7c8b-4e7d-af87-71c2a1b218bf tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:38:47.174719 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-32df9be8-7c8b-4e7d-af87-71c2a1b218bf tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1589968f375946a38e82ec484afc837f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c62c1f3c54f568abdac37360ab457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:38:47.186964 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-32df9be8-7c8b-4e7d-af87-71c2a1b218bf tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "GET /compute/v2.1/servers/e51de034-1fec-4513-a375-6b28e6180d82" status: 200 len: 1729 microversion: 2.1 time: 0.196007 May 19 21:38:47.187887 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 319/647] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:38:46 2022] GET /compute/v2.1/servers/e51de034-1fec-4513-a375-6b28e6180d82 => generated 1729 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:38:47.216323 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-ec73f662-a71d-481e-b836-c8f9358b7dff tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:38:47.217158 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-ec73f662-a71d-481e-b836-c8f9358b7dff tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: e51de034-1fec-4513-a375-6b28e6180d82] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:38:47.227689 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ec73f662-a71d-481e-b836-c8f9358b7dff tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:38:47.228386 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ec73f662-a71d-481e-b836-c8f9358b7dff tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:38:47.229618 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ec73f662-a71d-481e-b836-c8f9358b7dff tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:38:47.230374 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ec73f662-a71d-481e-b836-c8f9358b7dff tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:38:47.336614 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-ec73f662-a71d-481e-b836-c8f9358b7dff tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "GET /compute/v2.1/servers/e51de034-1fec-4513-a375-6b28e6180d82/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.127254 May 19 21:38:47.337248 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 329/648] 10.222.0.65 () {58 vars in 1274 bytes} [Thu May 19 21:38:47 2022] GET /compute/v2.1/servers/e51de034-1fec-4513-a375-6b28e6180d82/os-interface => generated 284 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 21:38:48.604865 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [req-b6875967-c67a-49d4-8384-d535c797ed6a req-0aedd2e9-8b4f-4eb6-af74-252fac5fd228 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e51de034-1fec-4513-a375-6b28e6180d82", "tag": "f6476118-5256-4fbe-bbbd-6fb7f8cb02c1"}]} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:38:48.615128 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-b6875967-c67a-49d4-8384-d535c797ed6a req-0aedd2e9-8b4f-4eb6-af74-252fac5fd228 service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:38:48.615574 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-b6875967-c67a-49d4-8384-d535c797ed6a req-0aedd2e9-8b4f-4eb6-af74-252fac5fd228 service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:38:48.629580 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.compute.server_external_events [req-b6875967-c67a-49d4-8384-d535c797ed6a req-0aedd2e9-8b4f-4eb6-af74-252fac5fd228 service nova] Creating event network-changed:f6476118-5256-4fbe-bbbd-6fb7f8cb02c1 for instance e51de034-1fec-4513-a375-6b28e6180d82 on hv-cinder-83563 May 19 21:38:48.637200 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [req-b6875967-c67a-49d4-8384-d535c797ed6a req-0aedd2e9-8b4f-4eb6-af74-252fac5fd228 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.214015 May 19 21:38:48.639133 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 320/649] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 21:38:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 21:38:50.656699 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [req-8e906671-b6b1-4612-9428-7cd56fb11f9a req-58d708bf-fb91-4d72-8d4d-18c1058f6001 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e51de034-1fec-4513-a375-6b28e6180d82", "tag": "f6476118-5256-4fbe-bbbd-6fb7f8cb02c1"}]} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:38:50.665194 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-8e906671-b6b1-4612-9428-7cd56fb11f9a req-58d708bf-fb91-4d72-8d4d-18c1058f6001 service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:38:50.665623 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-8e906671-b6b1-4612-9428-7cd56fb11f9a req-58d708bf-fb91-4d72-8d4d-18c1058f6001 service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:38:50.677782 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.compute.server_external_events [req-8e906671-b6b1-4612-9428-7cd56fb11f9a req-58d708bf-fb91-4d72-8d4d-18c1058f6001 service nova] Creating event network-changed:f6476118-5256-4fbe-bbbd-6fb7f8cb02c1 for instance e51de034-1fec-4513-a375-6b28e6180d82 on hv-cinder-83563 May 19 21:38:50.683207 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [req-8e906671-b6b1-4612-9428-7cd56fb11f9a req-58d708bf-fb91-4d72-8d4d-18c1058f6001 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030964 May 19 21:38:50.683818 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 330/650] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 21:38:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 21:38:57.662800 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-c8965f9d-b55e-4550-80e3-b5dcfc661906 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:38:57.663873 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-c8965f9d-b55e-4550-80e3-b5dcfc661906 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] [instance: 89cb2230-d75e-4c8c-b47b-83f1698654dd] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:38:57.666074 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_api:SELECT=29 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:38:57.673941 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c8965f9d-b55e-4550-80e3-b5dcfc661906 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:38:57.674424 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c8965f9d-b55e-4550-80e3-b5dcfc661906 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:38:57.675213 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c8965f9d-b55e-4550-80e3-b5dcfc661906 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:38:57.675648 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c8965f9d-b55e-4550-80e3-b5dcfc661906 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:38:57.678874 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:38:57.767309 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-c8965f9d-b55e-4550-80e3-b5dcfc661906 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] 10.222.0.65 "POST /compute/v2.1/servers/89cb2230-d75e-4c8c-b47b-83f1698654dd/action" status: 202 len: 0 microversion: 2.1 time: 0.108451 May 19 21:38:57.769630 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 321/651] 10.222.0.65 () {60 vars in 1277 bytes} [Thu May 19 21:38:57 2022] POST /compute/v2.1/servers/89cb2230-d75e-4c8c-b47b-83f1698654dd/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 21:38:57.783319 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-aa91a7c4-e941-4e2a-bf2d-7d7a6fb20b2a tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:38:57.784610 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-aa91a7c4-e941-4e2a-bf2d-7d7a6fb20b2a tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] [instance: 89cb2230-d75e-4c8c-b47b-83f1698654dd] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:38:57.789997 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_api:SELECT=29 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:38:57.799288 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-aa91a7c4-e941-4e2a-bf2d-7d7a6fb20b2a tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:38:57.800373 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-aa91a7c4-e941-4e2a-bf2d-7d7a6fb20b2a tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:38:57.801838 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-aa91a7c4-e941-4e2a-bf2d-7d7a6fb20b2a tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:38:57.802614 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-aa91a7c4-e941-4e2a-bf2d-7d7a6fb20b2a tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:38:57.812419 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell1:SELECT=79 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:38:58.011267 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-aa91a7c4-e941-4e2a-bf2d-7d7a6fb20b2a tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1664dba0cd9b4d9da1e4b78691b8567e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fcf03712c6f4926a2a95dfd0519536a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:38:58.020990 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-aa91a7c4-e941-4e2a-bf2d-7d7a6fb20b2a tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] 10.222.0.65 "GET /compute/v2.1/servers/89cb2230-d75e-4c8c-b47b-83f1698654dd" status: 200 len: 1751 microversion: 2.1 time: 0.246411 May 19 21:38:58.021762 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 331/652] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:38:57 2022] GET /compute/v2.1/servers/89cb2230-d75e-4c8c-b47b-83f1698654dd => generated 1751 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 21:38:58.439713 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-9de4fa32-8933-4257-a0d1-a5e79073aeae tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:38:58.440738 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-9de4fa32-8933-4257-a0d1-a5e79073aeae tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] [instance: a392a14d-152c-467f-8031-a4bb8e36e5bb] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:38:58.451937 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-9de4fa32-8933-4257-a0d1-a5e79073aeae tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:38:58.452603 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-9de4fa32-8933-4257-a0d1-a5e79073aeae tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:38:58.453945 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-9de4fa32-8933-4257-a0d1-a5e79073aeae tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:38:58.454737 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-9de4fa32-8933-4257-a0d1-a5e79073aeae tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:38:58.571303 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.objects.instance [None req-9de4fa32-8933-4257-a0d1-a5e79073aeae tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lazy-loading 'services' on Instance uuid a392a14d-152c-467f-8031-a4bb8e36e5bb {{(pid=124349) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 21:38:58.662016 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-9de4fa32-8933-4257-a0d1-a5e79073aeae tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] 10.222.0.65 "DELETE /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb/os-volume_attachments/26015889-7462-49e9-a316-f339ab1faac2" status: 202 len: 0 microversion: 2.1 time: 0.349540 May 19 21:38:58.663306 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 322/653] 10.222.0.65 () {58 vars in 1415 bytes} [Thu May 19 21:38:58 2022] DELETE /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb/os-volume_attachments/26015889-7462-49e9-a316-f339ab1faac2 => generated 0 bytes in 352 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 19 21:38:59.044940 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-883116ce-327e-45e6-b139-a9b5e9086845 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:38:59.045623 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-883116ce-327e-45e6-b139-a9b5e9086845 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] [instance: 89cb2230-d75e-4c8c-b47b-83f1698654dd] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:38:59.052725 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-883116ce-327e-45e6-b139-a9b5e9086845 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:38:59.053171 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-883116ce-327e-45e6-b139-a9b5e9086845 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:38:59.053954 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-883116ce-327e-45e6-b139-a9b5e9086845 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:38:59.054421 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-883116ce-327e-45e6-b139-a9b5e9086845 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:38:59.228921 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-883116ce-327e-45e6-b139-a9b5e9086845 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1664dba0cd9b4d9da1e4b78691b8567e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fcf03712c6f4926a2a95dfd0519536a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:38:59.238637 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-883116ce-327e-45e6-b139-a9b5e9086845 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] 10.222.0.65 "GET /compute/v2.1/servers/89cb2230-d75e-4c8c-b47b-83f1698654dd" status: 200 len: 1756 microversion: 2.1 time: 0.197976 May 19 21:38:59.239360 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 332/654] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:38:59 2022] GET /compute/v2.1/servers/89cb2230-d75e-4c8c-b47b-83f1698654dd => generated 1756 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:38:59.829082 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-1328dd92-2561-4fcf-88b8-6ed6db80ea09 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:38:59.836796 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1328dd92-2561-4fcf-88b8-6ed6db80ea09 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:38:59.837241 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1328dd92-2561-4fcf-88b8-6ed6db80ea09 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:38:59.863838 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-1328dd92-2561-4fcf-88b8-6ed6db80ea09 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] [instance: a392a14d-152c-467f-8031-a4bb8e36e5bb] Going to try to stop instance {{(pid=124349) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 19 21:38:59.913928 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-1328dd92-2561-4fcf-88b8-6ed6db80ea09 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] 10.222.0.65 "POST /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb/action" status: 202 len: 0 microversion: 2.1 time: 0.090135 May 19 21:38:59.914659 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 323/655] 10.222.0.65 () {60 vars in 1277 bytes} [Thu May 19 21:38:59 2022] POST /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 21:38:59.927155 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-31158754-7029-4d93-9ada-e364301f6d22 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:38:59.928271 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-31158754-7029-4d93-9ada-e364301f6d22 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] [instance: a392a14d-152c-467f-8031-a4bb8e36e5bb] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:38:59.939464 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-31158754-7029-4d93-9ada-e364301f6d22 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:38:59.940017 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-31158754-7029-4d93-9ada-e364301f6d22 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:38:59.941292 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-31158754-7029-4d93-9ada-e364301f6d22 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:38:59.942072 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-31158754-7029-4d93-9ada-e364301f6d22 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:39:00.149764 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-31158754-7029-4d93-9ada-e364301f6d22 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d16feb169ac46f7983a6b8045de77c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f5916770e9b443489fe7aa76d663fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:39:00.158080 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-31158754-7029-4d93-9ada-e364301f6d22 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] 10.222.0.65 "GET /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb" status: 200 len: 1677 microversion: 2.1 time: 0.238158 May 19 21:39:00.158688 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 333/656] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:38:59 2022] GET /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb => generated 1677 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 21:39:00.257686 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-59df0aa8-6f36-4789-8ed4-3bf707418350 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:39:00.258527 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-59df0aa8-6f36-4789-8ed4-3bf707418350 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] [instance: 89cb2230-d75e-4c8c-b47b-83f1698654dd] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:39:00.265723 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-59df0aa8-6f36-4789-8ed4-3bf707418350 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:39:00.266138 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-59df0aa8-6f36-4789-8ed4-3bf707418350 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:39:00.266963 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-59df0aa8-6f36-4789-8ed4-3bf707418350 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:39:00.267393 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-59df0aa8-6f36-4789-8ed4-3bf707418350 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:39:00.429184 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-59df0aa8-6f36-4789-8ed4-3bf707418350 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1664dba0cd9b4d9da1e4b78691b8567e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fcf03712c6f4926a2a95dfd0519536a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:39:00.442951 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-59df0aa8-6f36-4789-8ed4-3bf707418350 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] 10.222.0.65 "GET /compute/v2.1/servers/89cb2230-d75e-4c8c-b47b-83f1698654dd" status: 200 len: 1756 microversion: 2.1 time: 0.189146 May 19 21:39:00.443993 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 324/657] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:39:00 2022] GET /compute/v2.1/servers/89cb2230-d75e-4c8c-b47b-83f1698654dd => generated 1756 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:39:01.178909 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-8edf7cf9-79fa-4e5f-bf49-b562478a71a7 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:39:01.179823 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-8edf7cf9-79fa-4e5f-bf49-b562478a71a7 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] [instance: a392a14d-152c-467f-8031-a4bb8e36e5bb] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:39:01.188164 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8edf7cf9-79fa-4e5f-bf49-b562478a71a7 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:39:01.188614 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8edf7cf9-79fa-4e5f-bf49-b562478a71a7 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:39:01.189439 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8edf7cf9-79fa-4e5f-bf49-b562478a71a7 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:39:01.189867 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8edf7cf9-79fa-4e5f-bf49-b562478a71a7 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:39:01.348426 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-8edf7cf9-79fa-4e5f-bf49-b562478a71a7 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d16feb169ac46f7983a6b8045de77c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f5916770e9b443489fe7aa76d663fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:39:01.356684 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-8edf7cf9-79fa-4e5f-bf49-b562478a71a7 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] 10.222.0.65 "GET /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb" status: 200 len: 1677 microversion: 2.1 time: 0.184335 May 19 21:39:01.357257 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 334/658] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:39:01 2022] GET /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb => generated 1677 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:39:01.463123 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-e7628775-f1d6-4b18-944b-2df1a09f5c7a tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:39:01.463816 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-e7628775-f1d6-4b18-944b-2df1a09f5c7a tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] [instance: 89cb2230-d75e-4c8c-b47b-83f1698654dd] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:39:01.471434 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e7628775-f1d6-4b18-944b-2df1a09f5c7a tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:39:01.471891 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e7628775-f1d6-4b18-944b-2df1a09f5c7a tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:39:01.472663 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e7628775-f1d6-4b18-944b-2df1a09f5c7a tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:39:01.473111 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e7628775-f1d6-4b18-944b-2df1a09f5c7a tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:39:01.635244 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-e7628775-f1d6-4b18-944b-2df1a09f5c7a tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1664dba0cd9b4d9da1e4b78691b8567e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fcf03712c6f4926a2a95dfd0519536a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:39:01.649619 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-e7628775-f1d6-4b18-944b-2df1a09f5c7a tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] 10.222.0.65 "GET /compute/v2.1/servers/89cb2230-d75e-4c8c-b47b-83f1698654dd" status: 200 len: 1756 microversion: 2.1 time: 0.190331 May 19 21:39:01.650605 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 325/659] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:39:01 2022] GET /compute/v2.1/servers/89cb2230-d75e-4c8c-b47b-83f1698654dd => generated 1756 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:39:02.374833 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-12182a0b-0d31-4ece-ba16-70cfd1bf702d tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:39:02.375422 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-12182a0b-0d31-4ece-ba16-70cfd1bf702d tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] [instance: a392a14d-152c-467f-8031-a4bb8e36e5bb] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:39:02.382401 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-12182a0b-0d31-4ece-ba16-70cfd1bf702d tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:39:02.382836 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-12182a0b-0d31-4ece-ba16-70cfd1bf702d tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:39:02.383583 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-12182a0b-0d31-4ece-ba16-70cfd1bf702d tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:39:02.384006 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-12182a0b-0d31-4ece-ba16-70cfd1bf702d tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:39:02.539621 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-12182a0b-0d31-4ece-ba16-70cfd1bf702d tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d16feb169ac46f7983a6b8045de77c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f5916770e9b443489fe7aa76d663fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:39:02.551810 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-12182a0b-0d31-4ece-ba16-70cfd1bf702d tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] 10.222.0.65 "GET /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb" status: 200 len: 1677 microversion: 2.1 time: 0.180922 May 19 21:39:02.552665 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 335/660] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:39:02 2022] GET /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb => generated 1677 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:39:02.676231 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-dc8edcfd-85af-4ac9-bdac-d51138f9c8da tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:39:02.676862 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-dc8edcfd-85af-4ac9-bdac-d51138f9c8da tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] [instance: 89cb2230-d75e-4c8c-b47b-83f1698654dd] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:39:02.686052 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-dc8edcfd-85af-4ac9-bdac-d51138f9c8da tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:39:02.686546 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-dc8edcfd-85af-4ac9-bdac-d51138f9c8da tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:39:02.687354 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-dc8edcfd-85af-4ac9-bdac-d51138f9c8da tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:39:02.687786 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-dc8edcfd-85af-4ac9-bdac-d51138f9c8da tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:39:02.854810 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-dc8edcfd-85af-4ac9-bdac-d51138f9c8da tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1664dba0cd9b4d9da1e4b78691b8567e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fcf03712c6f4926a2a95dfd0519536a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:39:02.864228 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-dc8edcfd-85af-4ac9-bdac-d51138f9c8da tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] 10.222.0.65 "GET /compute/v2.1/servers/89cb2230-d75e-4c8c-b47b-83f1698654dd" status: 200 len: 1756 microversion: 2.1 time: 0.193493 May 19 21:39:02.864818 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 326/661] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:39:02 2022] GET /compute/v2.1/servers/89cb2230-d75e-4c8c-b47b-83f1698654dd => generated 1756 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:39:03.573718 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-e6e4d816-bc58-49df-a0a5-0e15cf4b1e4e tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:39:03.574496 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-e6e4d816-bc58-49df-a0a5-0e15cf4b1e4e tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] [instance: a392a14d-152c-467f-8031-a4bb8e36e5bb] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:39:03.581985 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e6e4d816-bc58-49df-a0a5-0e15cf4b1e4e tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:39:03.582467 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e6e4d816-bc58-49df-a0a5-0e15cf4b1e4e tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:39:03.583282 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e6e4d816-bc58-49df-a0a5-0e15cf4b1e4e tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:39:03.583711 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e6e4d816-bc58-49df-a0a5-0e15cf4b1e4e tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:39:03.726671 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-e6e4d816-bc58-49df-a0a5-0e15cf4b1e4e tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d16feb169ac46f7983a6b8045de77c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f5916770e9b443489fe7aa76d663fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:39:03.735329 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-e6e4d816-bc58-49df-a0a5-0e15cf4b1e4e tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] 10.222.0.65 "GET /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb" status: 200 len: 1677 microversion: 2.1 time: 0.165604 May 19 21:39:03.735910 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 336/662] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:39:03 2022] GET /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb => generated 1677 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:39:03.882512 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-ad1f2576-f41b-4ecb-8881-14bea2e2d5e8 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:39:03.883160 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-ad1f2576-f41b-4ecb-8881-14bea2e2d5e8 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] [instance: 89cb2230-d75e-4c8c-b47b-83f1698654dd] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:39:03.890609 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ad1f2576-f41b-4ecb-8881-14bea2e2d5e8 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:39:03.891048 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ad1f2576-f41b-4ecb-8881-14bea2e2d5e8 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:39:03.891856 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ad1f2576-f41b-4ecb-8881-14bea2e2d5e8 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:39:03.892278 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ad1f2576-f41b-4ecb-8881-14bea2e2d5e8 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:39:04.048923 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-ad1f2576-f41b-4ecb-8881-14bea2e2d5e8 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1664dba0cd9b4d9da1e4b78691b8567e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fcf03712c6f4926a2a95dfd0519536a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:39:04.057834 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-ad1f2576-f41b-4ecb-8881-14bea2e2d5e8 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] 10.222.0.65 "GET /compute/v2.1/servers/89cb2230-d75e-4c8c-b47b-83f1698654dd" status: 200 len: 1756 microversion: 2.1 time: 0.179230 May 19 21:39:04.058541 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 327/663] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:39:03 2022] GET /compute/v2.1/servers/89cb2230-d75e-4c8c-b47b-83f1698654dd => generated 1756 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:39:04.753387 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-d3541e8c-1f6e-4169-a369-c218a4231f37 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:39:04.753989 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-d3541e8c-1f6e-4169-a369-c218a4231f37 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] [instance: a392a14d-152c-467f-8031-a4bb8e36e5bb] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:39:04.760688 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d3541e8c-1f6e-4169-a369-c218a4231f37 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:39:04.761141 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d3541e8c-1f6e-4169-a369-c218a4231f37 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:39:04.761897 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d3541e8c-1f6e-4169-a369-c218a4231f37 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:39:04.762364 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d3541e8c-1f6e-4169-a369-c218a4231f37 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:39:04.904053 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-d3541e8c-1f6e-4169-a369-c218a4231f37 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d16feb169ac46f7983a6b8045de77c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f5916770e9b443489fe7aa76d663fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:39:04.912448 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-d3541e8c-1f6e-4169-a369-c218a4231f37 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] 10.222.0.65 "GET /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb" status: 200 len: 1677 microversion: 2.1 time: 0.162774 May 19 21:39:04.913037 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 337/664] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:39:04 2022] GET /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb => generated 1677 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:39:05.076383 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-093d5194-9f19-42fb-9e9d-53a650904778 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:39:05.076975 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-093d5194-9f19-42fb-9e9d-53a650904778 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] [instance: 89cb2230-d75e-4c8c-b47b-83f1698654dd] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:39:05.084645 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-093d5194-9f19-42fb-9e9d-53a650904778 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:39:05.085114 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-093d5194-9f19-42fb-9e9d-53a650904778 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:39:05.085916 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-093d5194-9f19-42fb-9e9d-53a650904778 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:39:05.086386 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-093d5194-9f19-42fb-9e9d-53a650904778 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:39:05.249095 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-093d5194-9f19-42fb-9e9d-53a650904778 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1664dba0cd9b4d9da1e4b78691b8567e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fcf03712c6f4926a2a95dfd0519536a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:39:05.259761 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-093d5194-9f19-42fb-9e9d-53a650904778 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] 10.222.0.65 "GET /compute/v2.1/servers/89cb2230-d75e-4c8c-b47b-83f1698654dd" status: 200 len: 1756 microversion: 2.1 time: 0.187296 May 19 21:39:05.260359 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 328/665] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:39:05 2022] GET /compute/v2.1/servers/89cb2230-d75e-4c8c-b47b-83f1698654dd => generated 1756 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:39:05.930684 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-6f6b2771-98c6-42b2-bdaf-31e11c326967 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:39:05.931312 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-6f6b2771-98c6-42b2-bdaf-31e11c326967 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] [instance: a392a14d-152c-467f-8031-a4bb8e36e5bb] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:39:05.938738 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6f6b2771-98c6-42b2-bdaf-31e11c326967 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:39:05.939203 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6f6b2771-98c6-42b2-bdaf-31e11c326967 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:39:05.939990 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6f6b2771-98c6-42b2-bdaf-31e11c326967 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:39:05.940422 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6f6b2771-98c6-42b2-bdaf-31e11c326967 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:39:06.088170 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-6f6b2771-98c6-42b2-bdaf-31e11c326967 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d16feb169ac46f7983a6b8045de77c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f5916770e9b443489fe7aa76d663fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:39:06.099468 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-6f6b2771-98c6-42b2-bdaf-31e11c326967 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] 10.222.0.65 "GET /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb" status: 200 len: 1677 microversion: 2.1 time: 0.172402 May 19 21:39:06.100178 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 338/666] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:39:05 2022] GET /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb => generated 1677 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:39:06.277456 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-1e491612-c25b-4e9a-b561-855862238d60 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:39:06.278000 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-1e491612-c25b-4e9a-b561-855862238d60 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] [instance: 89cb2230-d75e-4c8c-b47b-83f1698654dd] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:39:06.285039 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1e491612-c25b-4e9a-b561-855862238d60 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:39:06.285486 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1e491612-c25b-4e9a-b561-855862238d60 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:39:06.286281 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1e491612-c25b-4e9a-b561-855862238d60 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:39:06.286715 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1e491612-c25b-4e9a-b561-855862238d60 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:39:06.442878 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-1e491612-c25b-4e9a-b561-855862238d60 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1664dba0cd9b4d9da1e4b78691b8567e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fcf03712c6f4926a2a95dfd0519536a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:39:06.454025 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-1e491612-c25b-4e9a-b561-855862238d60 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] 10.222.0.65 "GET /compute/v2.1/servers/89cb2230-d75e-4c8c-b47b-83f1698654dd" status: 200 len: 1756 microversion: 2.1 time: 0.180454 May 19 21:39:06.454820 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 329/667] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:39:06 2022] GET /compute/v2.1/servers/89cb2230-d75e-4c8c-b47b-83f1698654dd => generated 1756 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:39:07.118104 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-b25d08d2-403c-4b7f-b750-cf3cd80b9447 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:39:07.118801 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-b25d08d2-403c-4b7f-b750-cf3cd80b9447 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] [instance: a392a14d-152c-467f-8031-a4bb8e36e5bb] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:39:07.126013 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b25d08d2-403c-4b7f-b750-cf3cd80b9447 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:39:07.126497 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b25d08d2-403c-4b7f-b750-cf3cd80b9447 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:39:07.127259 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b25d08d2-403c-4b7f-b750-cf3cd80b9447 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:39:07.127684 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b25d08d2-403c-4b7f-b750-cf3cd80b9447 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:39:07.273745 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-b25d08d2-403c-4b7f-b750-cf3cd80b9447 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d16feb169ac46f7983a6b8045de77c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f5916770e9b443489fe7aa76d663fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:39:07.282642 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-b25d08d2-403c-4b7f-b750-cf3cd80b9447 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] 10.222.0.65 "GET /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb" status: 200 len: 1677 microversion: 2.1 time: 0.168442 May 19 21:39:07.283181 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 339/668] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:39:07 2022] GET /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb => generated 1677 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:39:07.477336 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-1a936cbb-ae3f-4992-a2e6-7df5e937d741 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:39:07.477884 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-1a936cbb-ae3f-4992-a2e6-7df5e937d741 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] [instance: 89cb2230-d75e-4c8c-b47b-83f1698654dd] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:39:07.485220 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1a936cbb-ae3f-4992-a2e6-7df5e937d741 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:39:07.485668 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1a936cbb-ae3f-4992-a2e6-7df5e937d741 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:39:07.486470 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1a936cbb-ae3f-4992-a2e6-7df5e937d741 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:39:07.486907 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1a936cbb-ae3f-4992-a2e6-7df5e937d741 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:39:07.649801 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-1a936cbb-ae3f-4992-a2e6-7df5e937d741 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1664dba0cd9b4d9da1e4b78691b8567e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fcf03712c6f4926a2a95dfd0519536a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:39:07.667242 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-1a936cbb-ae3f-4992-a2e6-7df5e937d741 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] 10.222.0.65 "GET /compute/v2.1/servers/89cb2230-d75e-4c8c-b47b-83f1698654dd" status: 200 len: 1756 microversion: 2.1 time: 0.193557 May 19 21:39:07.668116 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 330/669] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:39:07 2022] GET /compute/v2.1/servers/89cb2230-d75e-4c8c-b47b-83f1698654dd => generated 1756 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:39:08.300736 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-ca5f71ca-66d4-4b22-8ede-fa76e1e9dc56 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:39:08.301321 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-ca5f71ca-66d4-4b22-8ede-fa76e1e9dc56 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] [instance: a392a14d-152c-467f-8031-a4bb8e36e5bb] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:39:08.308160 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ca5f71ca-66d4-4b22-8ede-fa76e1e9dc56 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:39:08.308604 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ca5f71ca-66d4-4b22-8ede-fa76e1e9dc56 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:39:08.309404 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ca5f71ca-66d4-4b22-8ede-fa76e1e9dc56 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:39:08.309853 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ca5f71ca-66d4-4b22-8ede-fa76e1e9dc56 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:39:08.449941 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-ca5f71ca-66d4-4b22-8ede-fa76e1e9dc56 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d16feb169ac46f7983a6b8045de77c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f5916770e9b443489fe7aa76d663fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:39:08.460020 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-ca5f71ca-66d4-4b22-8ede-fa76e1e9dc56 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] 10.222.0.65 "GET /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb" status: 200 len: 1677 microversion: 2.1 time: 0.163300 May 19 21:39:08.460647 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 340/670] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:39:08 2022] GET /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb => generated 1677 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:39:08.685499 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-43441e3c-d632-433c-b1c7-8cd1229c0744 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:39:08.686121 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-43441e3c-d632-433c-b1c7-8cd1229c0744 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] [instance: 89cb2230-d75e-4c8c-b47b-83f1698654dd] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:39:08.693546 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-43441e3c-d632-433c-b1c7-8cd1229c0744 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:39:08.693997 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-43441e3c-d632-433c-b1c7-8cd1229c0744 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:39:08.694821 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-43441e3c-d632-433c-b1c7-8cd1229c0744 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:39:08.695255 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-43441e3c-d632-433c-b1c7-8cd1229c0744 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:39:08.860115 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-43441e3c-d632-433c-b1c7-8cd1229c0744 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1664dba0cd9b4d9da1e4b78691b8567e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fcf03712c6f4926a2a95dfd0519536a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:39:08.868998 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-43441e3c-d632-433c-b1c7-8cd1229c0744 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] 10.222.0.65 "GET /compute/v2.1/servers/89cb2230-d75e-4c8c-b47b-83f1698654dd" status: 200 len: 1756 microversion: 2.1 time: 0.187417 May 19 21:39:08.869578 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 331/671] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:39:08 2022] GET /compute/v2.1/servers/89cb2230-d75e-4c8c-b47b-83f1698654dd => generated 1756 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:39:09.485812 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-eb0e487c-6e01-4b63-a78c-156a85b37744 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:39:09.486471 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-eb0e487c-6e01-4b63-a78c-156a85b37744 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] [instance: a392a14d-152c-467f-8031-a4bb8e36e5bb] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:39:09.494022 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-eb0e487c-6e01-4b63-a78c-156a85b37744 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:39:09.494506 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-eb0e487c-6e01-4b63-a78c-156a85b37744 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:39:09.495286 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-eb0e487c-6e01-4b63-a78c-156a85b37744 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:39:09.495708 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-eb0e487c-6e01-4b63-a78c-156a85b37744 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:39:09.632239 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-eb0e487c-6e01-4b63-a78c-156a85b37744 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d16feb169ac46f7983a6b8045de77c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f5916770e9b443489fe7aa76d663fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:39:09.640855 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-eb0e487c-6e01-4b63-a78c-156a85b37744 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] 10.222.0.65 "GET /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb" status: 200 len: 1677 microversion: 2.1 time: 0.159185 May 19 21:39:09.641425 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 341/672] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:39:09 2022] GET /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb => generated 1677 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:39:09.889753 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-1762d1a1-4f19-4b54-bb32-679bfda5a564 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:39:09.890815 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-1762d1a1-4f19-4b54-bb32-679bfda5a564 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] [instance: 89cb2230-d75e-4c8c-b47b-83f1698654dd] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:39:09.902564 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1762d1a1-4f19-4b54-bb32-679bfda5a564 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:39:09.903374 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1762d1a1-4f19-4b54-bb32-679bfda5a564 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:39:09.904624 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1762d1a1-4f19-4b54-bb32-679bfda5a564 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:39:09.905434 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1762d1a1-4f19-4b54-bb32-679bfda5a564 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:39:10.061918 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-1762d1a1-4f19-4b54-bb32-679bfda5a564 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1664dba0cd9b4d9da1e4b78691b8567e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fcf03712c6f4926a2a95dfd0519536a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:39:10.070571 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-1762d1a1-4f19-4b54-bb32-679bfda5a564 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] 10.222.0.65 "GET /compute/v2.1/servers/89cb2230-d75e-4c8c-b47b-83f1698654dd" status: 200 len: 1759 microversion: 2.1 time: 0.187807 May 19 21:39:10.071154 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 332/673] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:39:09 2022] GET /compute/v2.1/servers/89cb2230-d75e-4c8c-b47b-83f1698654dd => generated 1759 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:39:10.657294 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-5586c4fe-6fde-430a-922f-98d8a5e544d8 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:39:10.657906 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-5586c4fe-6fde-430a-922f-98d8a5e544d8 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] [instance: a392a14d-152c-467f-8031-a4bb8e36e5bb] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:39:10.664801 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5586c4fe-6fde-430a-922f-98d8a5e544d8 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:39:10.665242 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5586c4fe-6fde-430a-922f-98d8a5e544d8 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:39:10.666073 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5586c4fe-6fde-430a-922f-98d8a5e544d8 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:39:10.666475 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5586c4fe-6fde-430a-922f-98d8a5e544d8 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:39:10.815428 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-5586c4fe-6fde-430a-922f-98d8a5e544d8 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d16feb169ac46f7983a6b8045de77c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f5916770e9b443489fe7aa76d663fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:39:10.823264 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-5586c4fe-6fde-430a-922f-98d8a5e544d8 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] 10.222.0.65 "GET /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb" status: 200 len: 1654 microversion: 2.1 time: 0.169932 May 19 21:39:10.823845 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 342/674] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:39:10 2022] GET /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb => generated 1654 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:39:10.839924 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-415f09f1-40f2-47cc-8626-f84da00cd8e8 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:39:10.846283 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-415f09f1-40f2-47cc-8626-f84da00cd8e8 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:39:10.846706 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-415f09f1-40f2-47cc-8626-f84da00cd8e8 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:39:10.871750 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-415f09f1-40f2-47cc-8626-f84da00cd8e8 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] [instance: a392a14d-152c-467f-8031-a4bb8e36e5bb] Going to try to start instance {{(pid=124349) start /opt/stack/nova/nova/compute/api.py:2730}} May 19 21:39:10.916606 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-415f09f1-40f2-47cc-8626-f84da00cd8e8 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] 10.222.0.65 "POST /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb/action" status: 202 len: 0 microversion: 2.1 time: 0.080305 May 19 21:39:10.917263 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 333/675] 10.222.0.65 () {60 vars in 1277 bytes} [Thu May 19 21:39:10 2022] POST /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 21:39:10.925741 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-a1484452-7330-4aeb-9d34-b65c6e6dfabd tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:39:10.926374 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-a1484452-7330-4aeb-9d34-b65c6e6dfabd tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] [instance: a392a14d-152c-467f-8031-a4bb8e36e5bb] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:39:10.932610 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a1484452-7330-4aeb-9d34-b65c6e6dfabd tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:39:10.933097 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a1484452-7330-4aeb-9d34-b65c6e6dfabd tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:39:10.934103 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a1484452-7330-4aeb-9d34-b65c6e6dfabd tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:39:10.934693 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a1484452-7330-4aeb-9d34-b65c6e6dfabd tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:39:11.073063 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-a1484452-7330-4aeb-9d34-b65c6e6dfabd tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d16feb169ac46f7983a6b8045de77c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f5916770e9b443489fe7aa76d663fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:39:11.081498 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-a1484452-7330-4aeb-9d34-b65c6e6dfabd tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] 10.222.0.65 "GET /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb" status: 200 len: 1663 microversion: 2.1 time: 0.159252 May 19 21:39:11.082067 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 343/676] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:39:10 2022] GET /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb => generated 1663 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 21:39:12.100827 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-10173b46-e652-491b-ae26-8a1ee397143a tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:39:12.101422 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-10173b46-e652-491b-ae26-8a1ee397143a tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] [instance: a392a14d-152c-467f-8031-a4bb8e36e5bb] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:39:12.108530 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-10173b46-e652-491b-ae26-8a1ee397143a tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:39:12.109093 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-10173b46-e652-491b-ae26-8a1ee397143a tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:39:12.109695 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-10173b46-e652-491b-ae26-8a1ee397143a tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:39:12.110120 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-10173b46-e652-491b-ae26-8a1ee397143a tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:39:12.114496 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=3,nova_cell1:INSERT=4 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:39:12.253024 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-10173b46-e652-491b-ae26-8a1ee397143a tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d16feb169ac46f7983a6b8045de77c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f5916770e9b443489fe7aa76d663fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:39:12.263465 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-10173b46-e652-491b-ae26-8a1ee397143a tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] 10.222.0.65 "GET /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb" status: 200 len: 1663 microversion: 2.1 time: 0.167494 May 19 21:39:12.264322 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 334/677] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:39:12 2022] GET /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb => generated 1663 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:39:12.939684 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-ae64e4a5-057c-4604-ad05-ef259edd7fd2 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:39:12.940621 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-ae64e4a5-057c-4604-ad05-ef259edd7fd2 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: e0250d7d-3766-4555-a9af-2429afad53bf] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:39:12.947940 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ae64e4a5-057c-4604-ad05-ef259edd7fd2 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:39:12.948385 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ae64e4a5-057c-4604-ad05-ef259edd7fd2 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:39:12.949146 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ae64e4a5-057c-4604-ad05-ef259edd7fd2 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:39:12.949720 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ae64e4a5-057c-4604-ad05-ef259edd7fd2 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:39:12.982647 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-ae64e4a5-057c-4604-ad05-ef259edd7fd2 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf/os-volume_attachments/26cb0e21-2aa9-48a8-93d7-9d55730a71a6" status: 200 len: 194 microversion: 2.20 time: 0.047621 May 19 21:39:12.983399 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 344/678] 10.222.0.65 () {60 vars in 1453 bytes} [Thu May 19 21:39:12 2022] GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf/os-volume_attachments/26cb0e21-2aa9-48a8-93d7-9d55730a71a6 => generated 194 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 21:39:13.059274 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-e2e80b2b-0686-4caa-b936-865c5e38cca4 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:39:13.060128 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-e2e80b2b-0686-4caa-b936-865c5e38cca4 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: e0250d7d-3766-4555-a9af-2429afad53bf] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:39:13.066687 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e2e80b2b-0686-4caa-b936-865c5e38cca4 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:39:13.067143 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e2e80b2b-0686-4caa-b936-865c5e38cca4 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:39:13.067922 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e2e80b2b-0686-4caa-b936-865c5e38cca4 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:39:13.068360 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e2e80b2b-0686-4caa-b936-865c5e38cca4 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:39:13.172100 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.objects.instance [None req-e2e80b2b-0686-4caa-b936-865c5e38cca4 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lazy-loading 'services' on Instance uuid e0250d7d-3766-4555-a9af-2429afad53bf {{(pid=124349) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 21:39:13.258536 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-e2e80b2b-0686-4caa-b936-865c5e38cca4 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "DELETE /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf/os-volume_attachments/26cb0e21-2aa9-48a8-93d7-9d55730a71a6" status: 202 len: 0 microversion: 2.20 time: 0.203110 May 19 21:39:13.259143 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 335/679] 10.222.0.65 () {60 vars in 1456 bytes} [Thu May 19 21:39:13 2022] DELETE /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf/os-volume_attachments/26cb0e21-2aa9-48a8-93d7-9d55730a71a6 => generated 0 bytes in 205 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 19 21:39:13.267825 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-35f6a1c7-0d02-4405-9403-62b6dd3e4b1d tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:39:13.268797 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-35f6a1c7-0d02-4405-9403-62b6dd3e4b1d tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: e0250d7d-3766-4555-a9af-2429afad53bf] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:39:13.276784 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-35f6a1c7-0d02-4405-9403-62b6dd3e4b1d tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:39:13.277449 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-35f6a1c7-0d02-4405-9403-62b6dd3e4b1d tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:39:13.278679 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-35f6a1c7-0d02-4405-9403-62b6dd3e4b1d tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:39:13.281203 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-35f6a1c7-0d02-4405-9403-62b6dd3e4b1d tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:39:13.286614 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-eb803531-1456-40aa-8764-4f2d80ff296f tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:39:13.287356 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-eb803531-1456-40aa-8764-4f2d80ff296f tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] [instance: a392a14d-152c-467f-8031-a4bb8e36e5bb] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:39:13.305583 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-eb803531-1456-40aa-8764-4f2d80ff296f tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:39:13.306762 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-eb803531-1456-40aa-8764-4f2d80ff296f tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:39:13.307756 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-eb803531-1456-40aa-8764-4f2d80ff296f tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:39:13.308417 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-eb803531-1456-40aa-8764-4f2d80ff296f tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:39:13.318907 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-35f6a1c7-0d02-4405-9403-62b6dd3e4b1d tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055104 May 19 21:39:13.319881 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 345/680] 10.222.0.65 () {60 vars in 1342 bytes} [Thu May 19 21:39:13 2022] GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 21:39:13.462933 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-eb803531-1456-40aa-8764-4f2d80ff296f tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d16feb169ac46f7983a6b8045de77c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f5916770e9b443489fe7aa76d663fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:39:13.471879 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-eb803531-1456-40aa-8764-4f2d80ff296f tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] 10.222.0.65 "GET /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb" status: 200 len: 1667 microversion: 2.1 time: 0.189876 May 19 21:39:13.472473 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 336/681] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:39:13 2022] GET /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb => generated 1667 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:39:14.332123 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-33ca65d4-0908-4e83-9f75-4d43df8ded62 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:39:14.333035 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-33ca65d4-0908-4e83-9f75-4d43df8ded62 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: e0250d7d-3766-4555-a9af-2429afad53bf] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:39:14.339791 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-33ca65d4-0908-4e83-9f75-4d43df8ded62 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:39:14.340236 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-33ca65d4-0908-4e83-9f75-4d43df8ded62 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:39:14.340992 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-33ca65d4-0908-4e83-9f75-4d43df8ded62 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:39:14.341420 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-33ca65d4-0908-4e83-9f75-4d43df8ded62 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:39:14.376070 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-33ca65d4-0908-4e83-9f75-4d43df8ded62 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.048391 May 19 21:39:14.376630 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 346/682] 10.222.0.65 () {60 vars in 1342 bytes} [Thu May 19 21:39:14 2022] GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:39:14.437863 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-4014ecbd-4aa3-456b-b1f8-16d2312f81e8 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:39:14.438411 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-4014ecbd-4aa3-456b-b1f8-16d2312f81e8 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: e0250d7d-3766-4555-a9af-2429afad53bf] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:39:14.445440 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-4014ecbd-4aa3-456b-b1f8-16d2312f81e8 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:39:14.445886 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-4014ecbd-4aa3-456b-b1f8-16d2312f81e8 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:39:14.446683 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-4014ecbd-4aa3-456b-b1f8-16d2312f81e8 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:39:14.447105 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-4014ecbd-4aa3-456b-b1f8-16d2312f81e8 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:39:14.473997 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-4014ecbd-4aa3-456b-b1f8-16d2312f81e8 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: e0250d7d-3766-4555-a9af-2429afad53bf] Going to try to terminate instance {{(pid=124349) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 21:39:14.572057 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-4014ecbd-4aa3-456b-b1f8-16d2312f81e8 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "DELETE /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf" status: 204 len: 0 microversion: 2.20 time: 0.138028 May 19 21:39:14.572818 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 337/683] 10.222.0.65 () {60 vars in 1279 bytes} [Thu May 19 21:39:14 2022] DELETE /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 19 21:39:14.582384 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-66e7801f-c969-46e6-9a01-37f3dc53cef6 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:39:14.583151 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-66e7801f-c969-46e6-9a01-37f3dc53cef6 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: e0250d7d-3766-4555-a9af-2429afad53bf] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:39:14.589678 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-66e7801f-c969-46e6-9a01-37f3dc53cef6 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:39:14.590121 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-66e7801f-c969-46e6-9a01-37f3dc53cef6 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:39:14.590924 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-66e7801f-c969-46e6-9a01-37f3dc53cef6 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:39:14.591351 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-66e7801f-c969-46e6-9a01-37f3dc53cef6 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:39:14.751102 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-66e7801f-c969-46e6-9a01-37f3dc53cef6 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:39:14.753359 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell1:SELECT=100 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:39:14.760832 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-66e7801f-c969-46e6-9a01-37f3dc53cef6 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:39:14.762348 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-66e7801f-c969-46e6-9a01-37f3dc53cef6 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:39:14.763515 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-66e7801f-c969-46e6-9a01-37f3dc53cef6 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf" status: 200 len: 1724 microversion: 2.20 time: 0.185438 May 19 21:39:14.764116 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 347/684] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:39:14 2022] GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf => generated 1724 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:39:15.784363 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-22395ddf-7380-4b93-a8a8-de5b9ec1cbd0 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:39:15.785050 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-22395ddf-7380-4b93-a8a8-de5b9ec1cbd0 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: e0250d7d-3766-4555-a9af-2429afad53bf] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:39:15.791623 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-22395ddf-7380-4b93-a8a8-de5b9ec1cbd0 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:39:15.792047 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-22395ddf-7380-4b93-a8a8-de5b9ec1cbd0 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:39:15.792811 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-22395ddf-7380-4b93-a8a8-de5b9ec1cbd0 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:39:15.793237 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-22395ddf-7380-4b93-a8a8-de5b9ec1cbd0 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:39:15.979113 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-22395ddf-7380-4b93-a8a8-de5b9ec1cbd0 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:39:15.989059 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-22395ddf-7380-4b93-a8a8-de5b9ec1cbd0 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:39:15.990760 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-22395ddf-7380-4b93-a8a8-de5b9ec1cbd0 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:39:15.991956 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-22395ddf-7380-4b93-a8a8-de5b9ec1cbd0 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf" status: 200 len: 1724 microversion: 2.20 time: 0.212631 May 19 21:39:15.992553 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 338/685] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:39:15 2022] GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf => generated 1724 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:39:17.013381 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-19ba80bd-f045-4741-bc4b-f331e61ba260 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:39:17.014447 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-19ba80bd-f045-4741-bc4b-f331e61ba260 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: e0250d7d-3766-4555-a9af-2429afad53bf] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:39:17.023458 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-19ba80bd-f045-4741-bc4b-f331e61ba260 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:39:17.023965 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-19ba80bd-f045-4741-bc4b-f331e61ba260 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:39:17.025178 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-19ba80bd-f045-4741-bc4b-f331e61ba260 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:39:17.025810 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-19ba80bd-f045-4741-bc4b-f331e61ba260 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:39:17.126755 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-19ba80bd-f045-4741-bc4b-f331e61ba260 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:39:17.135588 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-19ba80bd-f045-4741-bc4b-f331e61ba260 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:39:17.137075 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-19ba80bd-f045-4741-bc4b-f331e61ba260 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:39:17.138263 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-19ba80bd-f045-4741-bc4b-f331e61ba260 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf" status: 200 len: 1657 microversion: 2.20 time: 0.129524 May 19 21:39:17.138843 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 348/686] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:39:17 2022] GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf => generated 1657 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:39:17.388633 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [req-82a083d2-27f4-4734-af50-51ddf61760c3 req-28e47a5e-8059-40fb-8ff9-3bfffceae2a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0250d7d-3766-4555-a9af-2429afad53bf", "name": "network-vif-deleted", "tag": "7fe0112e-1449-4e73-9fa1-f6d3a33168d8"}]} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:39:17.406634 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-82a083d2-27f4-4734-af50-51ddf61760c3 req-28e47a5e-8059-40fb-8ff9-3bfffceae2a9 service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:39:17.407296 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-82a083d2-27f4-4734-af50-51ddf61760c3 req-28e47a5e-8059-40fb-8ff9-3bfffceae2a9 service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:39:17.429138 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.compute.server_external_events [req-82a083d2-27f4-4734-af50-51ddf61760c3 req-28e47a5e-8059-40fb-8ff9-3bfffceae2a9 service nova] Creating event network-vif-deleted:7fe0112e-1449-4e73-9fa1-f6d3a33168d8 for instance e0250d7d-3766-4555-a9af-2429afad53bf on hv-cinder-83563 May 19 21:39:17.444391 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [req-82a083d2-27f4-4734-af50-51ddf61760c3 req-28e47a5e-8059-40fb-8ff9-3bfffceae2a9 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060043 May 19 21:39:17.446396 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 339/687] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 21:39:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 21:39:18.159234 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-7142fa00-1676-40ea-85b1-52cf8cbd67d4 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:39:18.160011 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-7142fa00-1676-40ea-85b1-52cf8cbd67d4 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: e0250d7d-3766-4555-a9af-2429afad53bf] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:39:18.167853 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7142fa00-1676-40ea-85b1-52cf8cbd67d4 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:39:18.168214 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7142fa00-1676-40ea-85b1-52cf8cbd67d4 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:39:18.168967 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7142fa00-1676-40ea-85b1-52cf8cbd67d4 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:39:18.169450 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7142fa00-1676-40ea-85b1-52cf8cbd67d4 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:39:18.184831 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.wsgi [None req-7142fa00-1676-40ea-85b1-52cf8cbd67d4 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] HTTP exception thrown: Instance e0250d7d-3766-4555-a9af-2429afad53bf could not be found. May 19 21:39:18.187426 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-7142fa00-1676-40ea-85b1-52cf8cbd67d4 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Request method failure captured: May 19 21:39:18.187426 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: request: GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf HTTP/1.1 May 19 21:39:18.187426 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Accept: application/json May 19 21:39:18.187426 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Accept-Encoding: identity May 19 21:39:18.187426 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Connection: close May 19 21:39:18.187426 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Content-Length: 0 May 19 21:39:18.187426 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Content-Type: application/json May 19 21:39:18.187426 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Host: 10.222.0.65 May 19 21:39:18.187426 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Openstack-System-Scope: None May 19 21:39:18.187426 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: User-Agent: python-urllib3/1.26.9 May 19 21:39:18.187426 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Auth-Token: gAAAAABihrdoc6hz2a2E2FuN7J_loAPbX8AXhy2RhsogI1W53kPZ59m7exARIi3hxYKQ7C6wyovLzjKkZcXQCKC0tQ1Gh_qG8pRtA_FTMargAAyCvpgFo2ObI_PTLJ4x15IiqBl110v9uavHO9t1uxTFspcE_biaBQqaMWYlj3RW2oqYxHj9nLw May 19 21:39:18.187426 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Domain-Id: None May 19 21:39:18.187426 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Domain-Name: None May 19 21:39:18.187426 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Identity-Status: Confirmed May 19 21:39:18.187426 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Is-Admin-Project: True May 19 21:39:18.187426 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Openstack-Nova-Api-Version: 2.20 May 19 21:39:18.187426 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Project-Domain-Id: default May 19 21:39:18.187426 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Project-Domain-Name: Default May 19 21:39:18.187426 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Project-Id: 92434c51e27a405aaa89a70a660f6d91 May 19 21:39:18.187426 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1939131256 May 19 21:39:18.187426 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Role: reader,member May 19 21:39:18.187426 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Roles: reader,member May 19 21:39:18.190185 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/92434c51e27a405aaa89a70a660f6d91"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/92434c51e27a405aaa89a70a660f6d91"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_92434c51e27a405aaa89a70a660f6d91"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/92434c51e27a405aaa89a70a660f6d91"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}] May 19 21:39:18.190185 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1939131256 May 19 21:39:18.190185 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Tenant-Id: 92434c51e27a405aaa89a70a660f6d91 May 19 21:39:18.190185 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1939131256 May 19 21:39:18.190185 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-User: tempest-AttachVolumeShelveTestJSON-1939131256-project May 19 21:39:18.190185 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-User-Domain-Id: default May 19 21:39:18.190185 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-User-Domain-Name: Default May 19 21:39:18.190185 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-User-Id: f47e7f746a014cb0a35390e7e0ce435d May 19 21:39:18.190185 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1939131256-project May 19 21:39:18.190185 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: method: > May 19 21:39:18.190185 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: exception: Instance e0250d7d-3766-4555-a9af-2429afad53bf could not be found. May 19 21:39:18.190185 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: action_args: {'id': 'e0250d7d-3766-4555-a9af-2429afad53bf'} May 19 21:39:18.191119 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 21:39:18.191119 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:39:18.191119 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 21:39:18.191119 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 21:39:18.191119 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 21:39:18.191119 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 21:39:18.191119 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 21:39:18.191119 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 21:39:18.191119 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 21:39:18.191119 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 21:39:18.191119 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0250d7d-3766-4555-a9af-2429afad53bf could not be found. May 19 21:39:18.191119 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi May 19 21:39:18.191119 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 21:39:18.191119 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi May 19 21:39:18.191119 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:39:18.191119 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 21:39:18.191119 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 21:39:18.191119 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 21:39:18.191119 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 21:39:18.191119 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 21:39:18.195149 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 21:39:18.195149 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 21:39:18.195149 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 21:39:18.195149 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 21:39:18.195149 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 21:39:18.195149 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 21:39:18.195149 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 21:39:18.195149 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0250d7d-3766-4555-a9af-2429afad53bf could not be found. May 19 21:39:18.195149 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi May 19 21:39:18.195149 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 21:39:18.195149 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi May 19 21:39:18.195149 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:39:18.195149 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 21:39:18.195149 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 21:39:18.195149 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 21:39:18.195149 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 21:39:18.195149 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0250d7d-3766-4555-a9af-2429afad53bf could not be found. May 19 21:39:18.195149 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi May 19 21:39:18.197971 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-7142fa00-1676-40ea-85b1-52cf8cbd67d4 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Returning 404 to user: Instance e0250d7d-3766-4555-a9af-2429afad53bf could not be found. {{(pid=124350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 21:39:18.197971 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-7142fa00-1676-40ea-85b1-52cf8cbd67d4 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf" status: 404 len: 111 microversion: 2.20 time: 0.035446 May 19 21:39:18.197971 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 349/688] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:39:18 2022] GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 19 21:39:18.200295 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-98a5b26a-6c39-4835-8fcc-c96a05c064fe tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '.version_select at 0x7fe363563160>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:39:18.225031 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-98a5b26a-6c39-4835-8fcc-c96a05c064fe tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1164290557" status: 204 len: 0 microversion: 2.20 time: 0.029935 May 19 21:39:18.225726 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 340/689] 10.222.0.65 () {60 vars in 1261 bytes} [Thu May 19 21:39:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1164290557 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 19 21:39:19.001827 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-ccbe6644-fb4f-4b1a-84c8-b5e29fdee43c tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Action: 'create', calling method: .version_select at 0x7fe3635f3b80>, body: {"keypair": {"name": "tempest-keypair-609015647", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAPhQDXx+UeGlhO9Pp11sTY+OUzj7m4Noe93vXSXq0fX5y5t2vJC6gcWZt8JCCOBiO1xF+oQocASkHveQ9r7oLYeCVYDrkxXlTmWU2s32Edg/9BikRUkfiBNpeUL0dQrPw=="}} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:39:19.018586 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.quota [None req-ccbe6644-fb4f-4b1a-84c8-b5e29fdee43c tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Getting quotas for project 92434c51e27a405aaa89a70a660f6d91. Resources: {'key_pairs'} {{(pid=124350) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 21:39:19.024062 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.quota [None req-ccbe6644-fb4f-4b1a-84c8-b5e29fdee43c tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Getting quotas for user f47e7f746a014cb0a35390e7e0ce435d and project 92434c51e27a405aaa89a70a660f6d91. Resources: {'key_pairs'} {{(pid=124350) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 21:39:19.054631 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-ccbe6644-fb4f-4b1a-84c8-b5e29fdee43c tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.057178 May 19 21:39:19.055247 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 350/690] 10.222.0.65 () {62 vars in 1199 bytes} [Thu May 19 21:39:18 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 59 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 19 21:39:20.840605 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-250ec7df-7fe2-48bf-823d-76a9ea986983 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1151240872", "imageRef": "a874457a-f8a8-46f6-bdcc-1fa632a0d3c0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "38652c76-1cd3-45cc-ad2f-1c69d9cadfb3"}], "security_groups": [{"name": "tempest-securitygroup--558212091"}], "key_name": "tempest-keypair-609015647", "user_data": "}} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:39:20.964117 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.network.neutron [None req-250ec7df-7fe2-48bf-823d-76a9ea986983 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] validate_networks() for [('38652c76-1cd3-45cc-ad2f-1c69d9cadfb3', None, None, None, None, None)] {{(pid=124349) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 19 21:39:21.164026 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-4953e52d-91a4-4bcd-a833-8d23a6ca4523 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:39:21.164598 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-4953e52d-91a4-4bcd-a833-8d23a6ca4523 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] [instance: 6442f189-c760-45c5-8313-4f1d3fe46461] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:39:21.175529 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4953e52d-91a4-4bcd-a833-8d23a6ca4523 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:39:21.176055 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4953e52d-91a4-4bcd-a833-8d23a6ca4523 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:39:21.177005 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4953e52d-91a4-4bcd-a833-8d23a6ca4523 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:39:21.177357 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4953e52d-91a4-4bcd-a833-8d23a6ca4523 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:39:21.226757 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-4953e52d-91a4-4bcd-a833-8d23a6ca4523 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] [instance: 6442f189-c760-45c5-8313-4f1d3fe46461] Going to try to terminate instance {{(pid=124350) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 21:39:21.351047 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-4953e52d-91a4-4bcd-a833-8d23a6ca4523 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] 10.222.0.65 "DELETE /compute/v2.1/servers/6442f189-c760-45c5-8313-4f1d3fe46461" status: 204 len: 0 microversion: 2.1 time: 0.314531 May 19 21:39:21.352430 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 351/691] 10.222.0.65 () {58 vars in 1238 bytes} [Thu May 19 21:39:21 2022] DELETE /compute/v2.1/servers/6442f189-c760-45c5-8313-4f1d3fe46461 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 19 21:39:21.364379 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-fa496a9e-918d-4cf1-895e-560d4e9718ba tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:39:21.365202 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-fa496a9e-918d-4cf1-895e-560d4e9718ba tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] [instance: 6442f189-c760-45c5-8313-4f1d3fe46461] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:39:21.371850 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-fa496a9e-918d-4cf1-895e-560d4e9718ba tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:39:21.372213 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-fa496a9e-918d-4cf1-895e-560d4e9718ba tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:39:21.372971 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-fa496a9e-918d-4cf1-895e-560d4e9718ba tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:39:21.373473 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-fa496a9e-918d-4cf1-895e-560d4e9718ba tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:39:21.541130 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.virt.hardware [None req-250ec7df-7fe2-48bf-823d-76a9ea986983 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Flavor limits 0:0:0 {{(pid=124349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 21:39:21.541554 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.virt.hardware [None req-250ec7df-7fe2-48bf-823d-76a9ea986983 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Image limits 0:0:0 {{(pid=124349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 21:39:21.542034 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.virt.hardware [None req-250ec7df-7fe2-48bf-823d-76a9ea986983 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Flavor pref 0:0:0 {{(pid=124349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 21:39:21.542535 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.virt.hardware [None req-250ec7df-7fe2-48bf-823d-76a9ea986983 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Image pref 0:0:0 {{(pid=124349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 21:39:21.542958 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.virt.hardware [None req-250ec7df-7fe2-48bf-823d-76a9ea986983 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 21:39:21.549149 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-fa496a9e-918d-4cf1-895e-560d4e9718ba tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a58f82117ab437cab5607c204c86547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4951b93f86e1485692a4aae7b9ece8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:39:21.552827 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-250ec7df-7fe2-48bf-823d-76a9ea986983 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:39:21.553344 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-250ec7df-7fe2-48bf-823d-76a9ea986983 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:39:21.554232 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-250ec7df-7fe2-48bf-823d-76a9ea986983 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:39:21.554752 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-250ec7df-7fe2-48bf-823d-76a9ea986983 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:39:21.557306 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-fa496a9e-918d-4cf1-895e-560d4e9718ba tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] 10.222.0.65 "GET /compute/v2.1/servers/6442f189-c760-45c5-8313-4f1d3fe46461" status: 200 len: 1576 microversion: 2.1 time: 0.197184 May 19 21:39:21.557888 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 352/692] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:39:21 2022] GET /compute/v2.1/servers/6442f189-c760-45c5-8313-4f1d3fe46461 => generated 1576 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 21:39:21.572874 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.quota [None req-250ec7df-7fe2-48bf-823d-76a9ea986983 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Getting quotas for project 92434c51e27a405aaa89a70a660f6d91. Resources: {'ram', 'cores', 'instances'} {{(pid=124349) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 21:39:21.577084 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.quota [None req-250ec7df-7fe2-48bf-823d-76a9ea986983 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Getting quotas for user f47e7f746a014cb0a35390e7e0ce435d and project 92434c51e27a405aaa89a70a660f6d91. Resources: {'ram', 'cores', 'instances'} {{(pid=124349) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 21:39:21.588541 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-250ec7df-7fe2-48bf-823d-76a9ea986983 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Going to run 1 instances... {{(pid=124349) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 21:39:21.590952 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-250ec7df-7fe2-48bf-823d-76a9ea986983 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: 446bb786-0ec7-4542-9509-36282d7126c8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a874457a-f8a8-46f6-bdcc-1fa632a0d3c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124349) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 21:39:21.641340 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-250ec7df-7fe2-48bf-823d-76a9ea986983 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.805583 May 19 21:39:21.641987 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 341/693] 10.222.0.65 () {62 vars in 1187 bytes} [Thu May 19 21:39:20 2022] POST /compute/v2.1/servers => generated 401 bytes in 807 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 19 21:39:21.652393 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-7782c438-04dc-4c4f-a004-01877cff08a5 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:39:21.653258 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-7782c438-04dc-4c4f-a004-01877cff08a5 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: 446bb786-0ec7-4542-9509-36282d7126c8] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:39:21.719216 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-7782c438-04dc-4c4f-a004-01877cff08a5 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:39:21.729460 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-7782c438-04dc-4c4f-a004-01877cff08a5 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:39:21.730995 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-7782c438-04dc-4c4f-a004-01877cff08a5 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:39:21.732163 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-7782c438-04dc-4c4f-a004-01877cff08a5 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8" status: 200 len: 1281 microversion: 2.20 time: 0.083776 May 19 21:39:21.732923 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 353/694] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:39:21 2022] GET /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8 => generated 1281 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:39:22.576087 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-0d3eb924-7c1e-43f0-ae5a-ab42bbf58cf0 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:39:22.576764 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-0d3eb924-7c1e-43f0-ae5a-ab42bbf58cf0 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] [instance: 6442f189-c760-45c5-8313-4f1d3fe46461] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:39:22.584244 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-0d3eb924-7c1e-43f0-ae5a-ab42bbf58cf0 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:39:22.584689 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-0d3eb924-7c1e-43f0-ae5a-ab42bbf58cf0 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:39:22.585469 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-0d3eb924-7c1e-43f0-ae5a-ab42bbf58cf0 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:39:22.585909 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-0d3eb924-7c1e-43f0-ae5a-ab42bbf58cf0 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:39:22.738051 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-0d3eb924-7c1e-43f0-ae5a-ab42bbf58cf0 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a58f82117ab437cab5607c204c86547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4951b93f86e1485692a4aae7b9ece8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:39:22.746382 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-0d3eb924-7c1e-43f0-ae5a-ab42bbf58cf0 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] 10.222.0.65 "GET /compute/v2.1/servers/6442f189-c760-45c5-8313-4f1d3fe46461" status: 200 len: 1576 microversion: 2.1 time: 0.174868 May 19 21:39:22.746992 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 342/695] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:39:22 2022] GET /compute/v2.1/servers/6442f189-c760-45c5-8313-4f1d3fe46461 => generated 1576 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:39:22.759168 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-2665200d-cf41-42d5-9676-73cccd00f08c tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:39:22.759751 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-2665200d-cf41-42d5-9676-73cccd00f08c tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: 446bb786-0ec7-4542-9509-36282d7126c8] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:39:22.767457 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2665200d-cf41-42d5-9676-73cccd00f08c tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:39:22.767893 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2665200d-cf41-42d5-9676-73cccd00f08c tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:39:22.768652 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2665200d-cf41-42d5-9676-73cccd00f08c tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:39:22.769080 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2665200d-cf41-42d5-9676-73cccd00f08c tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:39:23.079350 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-2665200d-cf41-42d5-9676-73cccd00f08c tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:39:23.087817 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-2665200d-cf41-42d5-9676-73cccd00f08c tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:39:23.089301 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-2665200d-cf41-42d5-9676-73cccd00f08c tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:39:23.090426 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-2665200d-cf41-42d5-9676-73cccd00f08c tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8" status: 200 len: 1333 microversion: 2.20 time: 0.335153 May 19 21:39:23.090984 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 354/696] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:39:22 2022] GET /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8 => generated 1333 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:39:23.763038 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-b56be2d0-f464-4ed5-9787-e6b14d1c011f tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:39:23.764334 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-b56be2d0-f464-4ed5-9787-e6b14d1c011f tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] [instance: 6442f189-c760-45c5-8313-4f1d3fe46461] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:39:23.771437 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-b56be2d0-f464-4ed5-9787-e6b14d1c011f tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:39:23.771881 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-b56be2d0-f464-4ed5-9787-e6b14d1c011f tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:39:23.772862 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-b56be2d0-f464-4ed5-9787-e6b14d1c011f tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:39:23.773306 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-b56be2d0-f464-4ed5-9787-e6b14d1c011f tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:39:24.006534 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-b56be2d0-f464-4ed5-9787-e6b14d1c011f tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a58f82117ab437cab5607c204c86547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4951b93f86e1485692a4aae7b9ece8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:39:24.021650 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-b56be2d0-f464-4ed5-9787-e6b14d1c011f tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] 10.222.0.65 "GET /compute/v2.1/servers/6442f189-c760-45c5-8313-4f1d3fe46461" status: 200 len: 1576 microversion: 2.1 time: 0.261814 May 19 21:39:24.022725 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 343/697] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:39:23 2022] GET /compute/v2.1/servers/6442f189-c760-45c5-8313-4f1d3fe46461 => generated 1576 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 21:39:24.110420 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-5de7a7ee-b73b-4ab3-81e4-a1854391b188 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:39:24.111049 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-5de7a7ee-b73b-4ab3-81e4-a1854391b188 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: 446bb786-0ec7-4542-9509-36282d7126c8] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:39:24.118328 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5de7a7ee-b73b-4ab3-81e4-a1854391b188 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:39:24.118772 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5de7a7ee-b73b-4ab3-81e4-a1854391b188 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:39:24.119909 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5de7a7ee-b73b-4ab3-81e4-a1854391b188 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:39:24.120450 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5de7a7ee-b73b-4ab3-81e4-a1854391b188 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:39:24.213868 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-5de7a7ee-b73b-4ab3-81e4-a1854391b188 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:39:24.226863 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-5de7a7ee-b73b-4ab3-81e4-a1854391b188 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:39:24.228665 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-5de7a7ee-b73b-4ab3-81e4-a1854391b188 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:39:24.230483 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-5de7a7ee-b73b-4ab3-81e4-a1854391b188 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8" status: 200 len: 1339 microversion: 2.20 time: 0.124780 May 19 21:39:24.249984 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 355/698] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:39:24 2022] GET /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8 => generated 1339 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:39:24.567853 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [req-8040809e-16f6-4cd4-87e4-662e29eefbf2 req-3218146d-669c-4cf7-ba80-7212966dc43a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6442f189-c760-45c5-8313-4f1d3fe46461", "name": "network-vif-deleted", "tag": "2963a31a-a224-4676-b867-1f60fa8904c2"}]} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:39:24.589777 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-8040809e-16f6-4cd4-87e4-662e29eefbf2 req-3218146d-669c-4cf7-ba80-7212966dc43a service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:39:24.591242 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-8040809e-16f6-4cd4-87e4-662e29eefbf2 req-3218146d-669c-4cf7-ba80-7212966dc43a service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:39:24.639714 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.compute.server_external_events [req-8040809e-16f6-4cd4-87e4-662e29eefbf2 req-3218146d-669c-4cf7-ba80-7212966dc43a service nova] Creating event network-vif-deleted:2963a31a-a224-4676-b867-1f60fa8904c2 for instance 6442f189-c760-45c5-8313-4f1d3fe46461 on hv-cinder-83563 May 19 21:39:24.650094 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [req-8040809e-16f6-4cd4-87e4-662e29eefbf2 req-3218146d-669c-4cf7-ba80-7212966dc43a service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087405 May 19 21:39:24.660366 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 344/699] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 21:39:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 21:39:25.041816 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-0b915b54-18d2-4bdf-97e9-0f19ef38fadf tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:39:25.042661 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-0b915b54-18d2-4bdf-97e9-0f19ef38fadf tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] [instance: 6442f189-c760-45c5-8313-4f1d3fe46461] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:39:25.062982 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0b915b54-18d2-4bdf-97e9-0f19ef38fadf tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:39:25.063749 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0b915b54-18d2-4bdf-97e9-0f19ef38fadf tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:39:25.068217 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0b915b54-18d2-4bdf-97e9-0f19ef38fadf tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:39:25.068663 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0b915b54-18d2-4bdf-97e9-0f19ef38fadf tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:39:25.128208 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0b915b54-18d2-4bdf-97e9-0f19ef38fadf tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:39:25.129281 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0b915b54-18d2-4bdf-97e9-0f19ef38fadf tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:39:25.129754 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.objects.instance [None req-0b915b54-18d2-4bdf-97e9-0f19ef38fadf tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lazy-loading 'fault' on Instance uuid 6442f189-c760-45c5-8313-4f1d3fe46461 {{(pid=124350) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 21:39:25.189437 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-0b915b54-18d2-4bdf-97e9-0f19ef38fadf tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a58f82117ab437cab5607c204c86547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4951b93f86e1485692a4aae7b9ece8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:39:25.202431 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-0b915b54-18d2-4bdf-97e9-0f19ef38fadf tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] 10.222.0.65 "GET /compute/v2.1/servers/6442f189-c760-45c5-8313-4f1d3fe46461" status: 200 len: 1231 microversion: 2.1 time: 0.165878 May 19 21:39:25.203585 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 356/700] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:39:25 2022] GET /compute/v2.1/servers/6442f189-c760-45c5-8313-4f1d3fe46461 => generated 1231 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:39:25.262045 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-e4155922-9c6a-4600-a6f9-18a3f1bd6cf4 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:39:25.263164 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-e4155922-9c6a-4600-a6f9-18a3f1bd6cf4 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: 446bb786-0ec7-4542-9509-36282d7126c8] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:39:25.272500 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e4155922-9c6a-4600-a6f9-18a3f1bd6cf4 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:39:25.273221 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e4155922-9c6a-4600-a6f9-18a3f1bd6cf4 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:39:25.274672 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e4155922-9c6a-4600-a6f9-18a3f1bd6cf4 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:39:25.275275 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e4155922-9c6a-4600-a6f9-18a3f1bd6cf4 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:39:25.337114 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [req-fe56a636-2fad-4566-b2aa-50fdb2419e43 req-875e08eb-c6a9-4b46-9411-32df8b2404da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "446bb786-0ec7-4542-9509-36282d7126c8", "tag": "a93c27fd-fadb-4f8a-be75-eddb5e3c3921"}]} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:39:25.358683 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-fe56a636-2fad-4566-b2aa-50fdb2419e43 req-875e08eb-c6a9-4b46-9411-32df8b2404da service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:39:25.359409 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-fe56a636-2fad-4566-b2aa-50fdb2419e43 req-875e08eb-c6a9-4b46-9411-32df8b2404da service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:39:25.386420 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.compute.server_external_events [req-fe56a636-2fad-4566-b2aa-50fdb2419e43 req-875e08eb-c6a9-4b46-9411-32df8b2404da service nova] Creating event network-changed:a93c27fd-fadb-4f8a-be75-eddb5e3c3921 for instance 446bb786-0ec7-4542-9509-36282d7126c8 on hv-cinder-83563 May 19 21:39:25.393691 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [req-fe56a636-2fad-4566-b2aa-50fdb2419e43 req-875e08eb-c6a9-4b46-9411-32df8b2404da service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060729 May 19 21:39:25.394337 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 357/701] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 21:39:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 21:39:25.634556 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-e4155922-9c6a-4600-a6f9-18a3f1bd6cf4 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:39:25.645840 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-e4155922-9c6a-4600-a6f9-18a3f1bd6cf4 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:39:25.649073 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-e4155922-9c6a-4600-a6f9-18a3f1bd6cf4 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:39:25.650704 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-e4155922-9c6a-4600-a6f9-18a3f1bd6cf4 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8" status: 200 len: 1406 microversion: 2.20 time: 0.395272 May 19 21:39:25.658332 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 345/702] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:39:25 2022] GET /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8 => generated 1406 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:39:26.229102 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-2830dce8-2270-415c-a138-dabfde11057f tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:39:26.229786 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-2830dce8-2270-415c-a138-dabfde11057f tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] [instance: 6442f189-c760-45c5-8313-4f1d3fe46461] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:39:26.236921 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2830dce8-2270-415c-a138-dabfde11057f tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:39:26.237370 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2830dce8-2270-415c-a138-dabfde11057f tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:39:26.238105 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2830dce8-2270-415c-a138-dabfde11057f tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:39:26.238603 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2830dce8-2270-415c-a138-dabfde11057f tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:39:26.418115 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.wsgi [None req-2830dce8-2270-415c-a138-dabfde11057f tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] HTTP exception thrown: Instance 6442f189-c760-45c5-8313-4f1d3fe46461 could not be found. May 19 21:39:26.419950 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-2830dce8-2270-415c-a138-dabfde11057f tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Request method failure captured: May 19 21:39:26.419950 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: request: GET /compute/v2.1/servers/6442f189-c760-45c5-8313-4f1d3fe46461 HTTP/1.1 May 19 21:39:26.419950 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Accept: application/json May 19 21:39:26.419950 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Accept-Encoding: identity May 19 21:39:26.419950 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Connection: close May 19 21:39:26.419950 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Content-Length: 0 May 19 21:39:26.419950 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Content-Type: application/json May 19 21:39:26.419950 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Host: 10.222.0.65 May 19 21:39:26.419950 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Openstack-System-Scope: None May 19 21:39:26.419950 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: User-Agent: python-urllib3/1.26.9 May 19 21:39:26.419950 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Auth-Token: gAAAAABihrfGK__DJuYwI5JFz7AYjoJ5gQpF1NeU2sp6GL9Qm9r1qL-i4GqBqmgs0jr4aqzBtoAgR05QaRiKLd4CAlxsJ2Ka7-M6bw7EJFeb6jfz-DF94qKLiELFhcDH5F0ovdWhowq_VcBc9NHl4Po_3pwvmY2AqKHahlmuAmlCLH3bMLBrU08 May 19 21:39:26.419950 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Domain-Id: None May 19 21:39:26.419950 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Domain-Name: None May 19 21:39:26.419950 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Identity-Status: Confirmed May 19 21:39:26.419950 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Is-Admin-Project: True May 19 21:39:26.419950 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Project-Domain-Id: default May 19 21:39:26.419950 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Project-Domain-Name: Default May 19 21:39:26.419950 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Project-Id: 4951b93f86e1485692a4aae7b9ece8f6 May 19 21:39:26.419950 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Project-Name: tempest-TestVolumeBootPattern-2027905667 May 19 21:39:26.419950 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Role: reader,member May 19 21:39:26.419950 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Roles: reader,member May 19 21:39:26.421665 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/4951b93f86e1485692a4aae7b9ece8f6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/4951b93f86e1485692a4aae7b9ece8f6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_4951b93f86e1485692a4aae7b9ece8f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/4951b93f86e1485692a4aae7b9ece8f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}] May 19 21:39:26.421665 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Tenant: tempest-TestVolumeBootPattern-2027905667 May 19 21:39:26.421665 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Tenant-Id: 4951b93f86e1485692a4aae7b9ece8f6 May 19 21:39:26.421665 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Tenant-Name: tempest-TestVolumeBootPattern-2027905667 May 19 21:39:26.421665 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-User: tempest-TestVolumeBootPattern-2027905667-project May 19 21:39:26.421665 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-User-Domain-Id: default May 19 21:39:26.421665 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-User-Domain-Name: Default May 19 21:39:26.421665 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-User-Id: 0a58f82117ab437cab5607c204c86547 May 19 21:39:26.421665 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-User-Name: tempest-TestVolumeBootPattern-2027905667-project May 19 21:39:26.421665 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: method: > May 19 21:39:26.421665 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: exception: Instance 6442f189-c760-45c5-8313-4f1d3fe46461 could not be found. May 19 21:39:26.421665 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: action_args: {'id': '6442f189-c760-45c5-8313-4f1d3fe46461'} May 19 21:39:26.422650 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 21:39:26.422650 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:39:26.422650 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 21:39:26.422650 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 21:39:26.422650 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 21:39:26.422650 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 21:39:26.422650 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 21:39:26.422650 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 21:39:26.422650 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 21:39:26.422650 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 21:39:26.422650 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6442f189-c760-45c5-8313-4f1d3fe46461 could not be found. May 19 21:39:26.422650 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi May 19 21:39:26.422650 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 21:39:26.422650 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi May 19 21:39:26.422650 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:39:26.422650 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 21:39:26.422650 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 21:39:26.422650 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 21:39:26.422650 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 21:39:26.422650 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 21:39:26.424059 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 21:39:26.424059 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 21:39:26.424059 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 21:39:26.424059 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 21:39:26.424059 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 21:39:26.424059 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 21:39:26.424059 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 21:39:26.424059 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6442f189-c760-45c5-8313-4f1d3fe46461 could not be found. May 19 21:39:26.424059 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi May 19 21:39:26.424059 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 21:39:26.424059 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi May 19 21:39:26.424059 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:39:26.424059 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 21:39:26.424059 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 21:39:26.424059 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 21:39:26.424059 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 21:39:26.424059 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6442f189-c760-45c5-8313-4f1d3fe46461 could not be found. May 19 21:39:26.424059 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi May 19 21:39:26.425416 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-2830dce8-2270-415c-a138-dabfde11057f tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Returning 404 to user: Instance 6442f189-c760-45c5-8313-4f1d3fe46461 could not be found. {{(pid=124350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 21:39:26.425416 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-2830dce8-2270-415c-a138-dabfde11057f tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] 10.222.0.65 "GET /compute/v2.1/servers/6442f189-c760-45c5-8313-4f1d3fe46461" status: 404 len: 111 microversion: 2.1 time: 0.197825 May 19 21:39:26.425416 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 358/703] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:39:26 2022] GET /compute/v2.1/servers/6442f189-c760-45c5-8313-4f1d3fe46461 => generated 111 bytes in 199 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 21:39:26.474500 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-c87ab18e-469d-46fa-904f-27dface88773 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1355540963", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2053369052", "security_groups": [{"name": "tempest-secgroup-smoke-1388373731"}], "block_device_mapping_v2": [{"uuid": "7c2894cf-b2c6-4427-86ee-ba2b4af04cc0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "d5d9547d-2306-4c78-9ac6-532192256ea5"}]}} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:39:26.600133 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.network.neutron [None req-c87ab18e-469d-46fa-904f-27dface88773 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] validate_networks() for [('d5d9547d-2306-4c78-9ac6-532192256ea5', None, None, None, None, None)] {{(pid=124349) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 19 21:39:26.669863 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-cc5405fa-8fe6-44a5-b58d-f4cda7f2760e tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:39:26.670445 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-cc5405fa-8fe6-44a5-b58d-f4cda7f2760e tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: 446bb786-0ec7-4542-9509-36282d7126c8] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:39:26.677030 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cc5405fa-8fe6-44a5-b58d-f4cda7f2760e tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:39:26.677474 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cc5405fa-8fe6-44a5-b58d-f4cda7f2760e tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:39:26.678366 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cc5405fa-8fe6-44a5-b58d-f4cda7f2760e tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:39:26.678921 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cc5405fa-8fe6-44a5-b58d-f4cda7f2760e tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:39:26.835897 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-cc5405fa-8fe6-44a5-b58d-f4cda7f2760e tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:39:26.847361 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-cc5405fa-8fe6-44a5-b58d-f4cda7f2760e tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:39:26.849425 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-cc5405fa-8fe6-44a5-b58d-f4cda7f2760e tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:39:26.850603 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-cc5405fa-8fe6-44a5-b58d-f4cda7f2760e tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8" status: 200 len: 1406 microversion: 2.20 time: 0.185024 May 19 21:39:26.851150 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 359/704] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:39:26 2022] GET /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8 => generated 1406 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:39:27.002493 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.virt.hardware [None req-c87ab18e-469d-46fa-904f-27dface88773 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Flavor limits 0:0:0 {{(pid=124349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 21:39:27.002975 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.virt.hardware [None req-c87ab18e-469d-46fa-904f-27dface88773 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Image limits 0:0:0 {{(pid=124349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 21:39:27.003458 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.virt.hardware [None req-c87ab18e-469d-46fa-904f-27dface88773 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Flavor pref 0:0:0 {{(pid=124349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 21:39:27.003875 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.virt.hardware [None req-c87ab18e-469d-46fa-904f-27dface88773 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Image pref 0:0:0 {{(pid=124349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 21:39:27.004354 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.virt.hardware [None req-c87ab18e-469d-46fa-904f-27dface88773 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 21:39:27.015686 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c87ab18e-469d-46fa-904f-27dface88773 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:39:27.016172 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c87ab18e-469d-46fa-904f-27dface88773 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:39:27.016991 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c87ab18e-469d-46fa-904f-27dface88773 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:39:27.017474 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c87ab18e-469d-46fa-904f-27dface88773 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:39:27.035089 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.quota [None req-c87ab18e-469d-46fa-904f-27dface88773 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Getting quotas for project 4951b93f86e1485692a4aae7b9ece8f6. Resources: {'ram', 'cores', 'instances'} {{(pid=124349) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 21:39:27.039204 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.quota [None req-c87ab18e-469d-46fa-904f-27dface88773 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Getting quotas for user 0a58f82117ab437cab5607c204c86547 and project 4951b93f86e1485692a4aae7b9ece8f6. Resources: {'ram', 'cores', 'instances'} {{(pid=124349) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 21:39:27.105396 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-c87ab18e-469d-46fa-904f-27dface88773 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Going to run 1 instances... {{(pid=124349) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 21:39:27.109053 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-c87ab18e-469d-46fa-904f-27dface88773 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] [instance: 19887ef9-2867-4e11-ad73-ad8c2eb0871b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7c2894cf-b2c6-4427-86ee-ba2b4af04cc0',volume_size=None,volume_type=None)] {{(pid=124349) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 21:39:27.258226 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-c87ab18e-469d-46fa-904f-27dface88773 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.789090 May 19 21:39:27.258929 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 346/705] 10.222.0.65 () {60 vars in 1146 bytes} [Thu May 19 21:39:26 2022] POST /compute/v2.1/servers => generated 406 bytes in 791 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 19 21:39:27.269559 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-a1164264-d757-44ee-8350-8ba15afe3a49 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:39:27.270287 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-a1164264-d757-44ee-8350-8ba15afe3a49 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] [instance: 19887ef9-2867-4e11-ad73-ad8c2eb0871b] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:39:27.327506 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-a1164264-d757-44ee-8350-8ba15afe3a49 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a58f82117ab437cab5607c204c86547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4951b93f86e1485692a4aae7b9ece8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:39:27.335560 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-a1164264-d757-44ee-8350-8ba15afe3a49 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] 10.222.0.65 "GET /compute/v2.1/servers/19887ef9-2867-4e11-ad73-ad8c2eb0871b" status: 200 len: 1095 microversion: 2.1 time: 0.069855 May 19 21:39:27.336195 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 360/706] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:39:27 2022] GET /compute/v2.1/servers/19887ef9-2867-4e11-ad73-ad8c2eb0871b => generated 1095 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:39:27.869743 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-cc72ce39-0703-40f0-a1f3-e4988d54b4de tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:39:27.870421 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-cc72ce39-0703-40f0-a1f3-e4988d54b4de tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: 446bb786-0ec7-4542-9509-36282d7126c8] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:39:27.872430 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:39:27.878687 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-cc72ce39-0703-40f0-a1f3-e4988d54b4de tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:39:27.879177 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-cc72ce39-0703-40f0-a1f3-e4988d54b4de tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:39:27.879948 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-cc72ce39-0703-40f0-a1f3-e4988d54b4de tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:39:27.880356 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-cc72ce39-0703-40f0-a1f3-e4988d54b4de tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:39:28.022428 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-cc72ce39-0703-40f0-a1f3-e4988d54b4de tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:39:28.032014 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-cc72ce39-0703-40f0-a1f3-e4988d54b4de tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:39:28.033460 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-cc72ce39-0703-40f0-a1f3-e4988d54b4de tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:39:28.034589 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-cc72ce39-0703-40f0-a1f3-e4988d54b4de tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8" status: 200 len: 1406 microversion: 2.20 time: 0.169318 May 19 21:39:28.035123 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 347/707] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:39:27 2022] GET /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8 => generated 1406 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:39:28.355205 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-c8dc35fd-9100-4aa2-b765-2f198c6296de tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:39:28.355795 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-c8dc35fd-9100-4aa2-b765-2f198c6296de tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] [instance: 19887ef9-2867-4e11-ad73-ad8c2eb0871b] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:39:28.358807 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:39:28.364926 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c8dc35fd-9100-4aa2-b765-2f198c6296de tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:39:28.365359 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c8dc35fd-9100-4aa2-b765-2f198c6296de tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:39:28.366110 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c8dc35fd-9100-4aa2-b765-2f198c6296de tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:39:28.366569 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c8dc35fd-9100-4aa2-b765-2f198c6296de tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:39:28.432418 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-c8dc35fd-9100-4aa2-b765-2f198c6296de tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a58f82117ab437cab5607c204c86547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4951b93f86e1485692a4aae7b9ece8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:39:28.440259 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-c8dc35fd-9100-4aa2-b765-2f198c6296de tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] 10.222.0.65 "GET /compute/v2.1/servers/19887ef9-2867-4e11-ad73-ad8c2eb0871b" status: 200 len: 1145 microversion: 2.1 time: 0.090542 May 19 21:39:28.440808 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 361/708] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:39:28 2022] GET /compute/v2.1/servers/19887ef9-2867-4e11-ad73-ad8c2eb0871b => generated 1145 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:39:29.052988 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-2d566611-eba0-4a5b-b0e5-6200425cd764 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:39:29.053558 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-2d566611-eba0-4a5b-b0e5-6200425cd764 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: 446bb786-0ec7-4542-9509-36282d7126c8] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:39:29.060558 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-2d566611-eba0-4a5b-b0e5-6200425cd764 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:39:29.061123 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-2d566611-eba0-4a5b-b0e5-6200425cd764 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:39:29.062163 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-2d566611-eba0-4a5b-b0e5-6200425cd764 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:39:29.062677 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-2d566611-eba0-4a5b-b0e5-6200425cd764 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:39:29.294670 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-2d566611-eba0-4a5b-b0e5-6200425cd764 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:39:29.304629 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-2d566611-eba0-4a5b-b0e5-6200425cd764 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:39:29.306391 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-2d566611-eba0-4a5b-b0e5-6200425cd764 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:39:29.307767 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-2d566611-eba0-4a5b-b0e5-6200425cd764 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8" status: 200 len: 1406 microversion: 2.20 time: 0.258904 May 19 21:39:29.309013 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 348/709] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:39:29 2022] GET /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8 => generated 1406 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:39:29.457324 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-beba9006-544c-480d-807e-94dfe7fa62ac tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:39:29.457970 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-beba9006-544c-480d-807e-94dfe7fa62ac tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] [instance: 19887ef9-2867-4e11-ad73-ad8c2eb0871b] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:39:29.464950 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-beba9006-544c-480d-807e-94dfe7fa62ac tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:39:29.465381 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-beba9006-544c-480d-807e-94dfe7fa62ac tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:39:29.466148 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-beba9006-544c-480d-807e-94dfe7fa62ac tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:39:29.466608 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-beba9006-544c-480d-807e-94dfe7fa62ac tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:39:29.542578 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-beba9006-544c-480d-807e-94dfe7fa62ac tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a58f82117ab437cab5607c204c86547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4951b93f86e1485692a4aae7b9ece8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:39:29.550940 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-beba9006-544c-480d-807e-94dfe7fa62ac tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] 10.222.0.65 "GET /compute/v2.1/servers/19887ef9-2867-4e11-ad73-ad8c2eb0871b" status: 200 len: 1211 microversion: 2.1 time: 0.097773 May 19 21:39:29.551501 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 362/710] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:39:29 2022] GET /compute/v2.1/servers/19887ef9-2867-4e11-ad73-ad8c2eb0871b => generated 1211 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:39:30.327032 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-18abf43d-20d1-4bb4-92b5-6e0068a52c8f tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:39:30.328299 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-18abf43d-20d1-4bb4-92b5-6e0068a52c8f tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: 446bb786-0ec7-4542-9509-36282d7126c8] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:39:30.335533 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-18abf43d-20d1-4bb4-92b5-6e0068a52c8f tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:39:30.336001 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-18abf43d-20d1-4bb4-92b5-6e0068a52c8f tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:39:30.336763 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-18abf43d-20d1-4bb4-92b5-6e0068a52c8f tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:39:30.337188 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-18abf43d-20d1-4bb4-92b5-6e0068a52c8f tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:39:30.474724 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-18abf43d-20d1-4bb4-92b5-6e0068a52c8f tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:39:30.485932 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-18abf43d-20d1-4bb4-92b5-6e0068a52c8f tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:39:30.495593 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-18abf43d-20d1-4bb4-92b5-6e0068a52c8f tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:39:30.503990 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-18abf43d-20d1-4bb4-92b5-6e0068a52c8f tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8" status: 200 len: 1406 microversion: 2.20 time: 0.180962 May 19 21:39:30.504588 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 349/711] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:39:30 2022] GET /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8 => generated 1406 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:39:30.573033 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-7c61734c-677f-4c35-aa9a-365f636e3f13 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:39:30.576099 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-7c61734c-677f-4c35-aa9a-365f636e3f13 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] [instance: 19887ef9-2867-4e11-ad73-ad8c2eb0871b] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:39:30.584090 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7c61734c-677f-4c35-aa9a-365f636e3f13 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:39:30.584689 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7c61734c-677f-4c35-aa9a-365f636e3f13 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:39:30.585542 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7c61734c-677f-4c35-aa9a-365f636e3f13 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:39:30.586072 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7c61734c-677f-4c35-aa9a-365f636e3f13 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:39:30.817330 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [req-6495515e-0207-434c-8838-c137823314cf req-57397a07-9f3d-482d-bd29-b0db5e78d2b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19887ef9-2867-4e11-ad73-ad8c2eb0871b", "tag": "1de7b941-4923-4121-aea7-13eb18ac70b9"}]} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:39:30.832452 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-7c61734c-677f-4c35-aa9a-365f636e3f13 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a58f82117ab437cab5607c204c86547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4951b93f86e1485692a4aae7b9ece8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:39:30.836010 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-6495515e-0207-434c-8838-c137823314cf req-57397a07-9f3d-482d-bd29-b0db5e78d2b9 service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:39:30.836444 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-6495515e-0207-434c-8838-c137823314cf req-57397a07-9f3d-482d-bd29-b0db5e78d2b9 service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:39:30.849111 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-7c61734c-677f-4c35-aa9a-365f636e3f13 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] 10.222.0.65 "GET /compute/v2.1/servers/19887ef9-2867-4e11-ad73-ad8c2eb0871b" status: 200 len: 1267 microversion: 2.1 time: 0.284335 May 19 21:39:30.849702 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 363/712] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:39:30 2022] GET /compute/v2.1/servers/19887ef9-2867-4e11-ad73-ad8c2eb0871b => generated 1267 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:39:30.871611 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.compute.server_external_events [req-6495515e-0207-434c-8838-c137823314cf req-57397a07-9f3d-482d-bd29-b0db5e78d2b9 service nova] Creating event network-changed:1de7b941-4923-4121-aea7-13eb18ac70b9 for instance 19887ef9-2867-4e11-ad73-ad8c2eb0871b on hv-cinder-83563 May 19 21:39:30.878088 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [req-6495515e-0207-434c-8838-c137823314cf req-57397a07-9f3d-482d-bd29-b0db5e78d2b9 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065015 May 19 21:39:30.879467 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 350/713] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 21:39:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 21:39:31.523187 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-111a7d3f-7531-4ea6-a7ea-9345fd9fa60e tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:39:31.523685 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-111a7d3f-7531-4ea6-a7ea-9345fd9fa60e tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: 446bb786-0ec7-4542-9509-36282d7126c8] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:39:31.531032 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-111a7d3f-7531-4ea6-a7ea-9345fd9fa60e tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:39:31.531678 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-111a7d3f-7531-4ea6-a7ea-9345fd9fa60e tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:39:31.532460 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-111a7d3f-7531-4ea6-a7ea-9345fd9fa60e tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:39:31.532901 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-111a7d3f-7531-4ea6-a7ea-9345fd9fa60e tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:39:31.687532 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-111a7d3f-7531-4ea6-a7ea-9345fd9fa60e tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:39:31.696427 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-111a7d3f-7531-4ea6-a7ea-9345fd9fa60e tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:39:31.697934 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-111a7d3f-7531-4ea6-a7ea-9345fd9fa60e tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:39:31.699132 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-111a7d3f-7531-4ea6-a7ea-9345fd9fa60e tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8" status: 200 len: 1406 microversion: 2.20 time: 0.180485 May 19 21:39:31.699704 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 364/714] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:39:31 2022] GET /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8 => generated 1406 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:39:31.868574 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-96664ced-5d23-48b4-a326-c94b37db8c46 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:39:31.868997 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-96664ced-5d23-48b4-a326-c94b37db8c46 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] [instance: 19887ef9-2867-4e11-ad73-ad8c2eb0871b] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:39:31.876510 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-96664ced-5d23-48b4-a326-c94b37db8c46 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:39:31.876927 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-96664ced-5d23-48b4-a326-c94b37db8c46 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:39:31.877677 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-96664ced-5d23-48b4-a326-c94b37db8c46 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:39:31.878109 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-96664ced-5d23-48b4-a326-c94b37db8c46 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:39:32.022368 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-96664ced-5d23-48b4-a326-c94b37db8c46 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a58f82117ab437cab5607c204c86547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4951b93f86e1485692a4aae7b9ece8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:39:32.032027 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-96664ced-5d23-48b4-a326-c94b37db8c46 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] 10.222.0.65 "GET /compute/v2.1/servers/19887ef9-2867-4e11-ad73-ad8c2eb0871b" status: 200 len: 1267 microversion: 2.1 time: 0.169009 May 19 21:39:32.032614 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 351/715] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:39:31 2022] GET /compute/v2.1/servers/19887ef9-2867-4e11-ad73-ad8c2eb0871b => generated 1267 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:39:32.129305 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [req-e8fc8d5e-8b13-4a9b-867e-2c5baca70dd6 req-87c96bee-2816-4437-8da7-ec4398f53c78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "446bb786-0ec7-4542-9509-36282d7126c8", "name": "network-vif-plugged", "status": "completed", "tag": "a93c27fd-fadb-4f8a-be75-eddb5e3c3921"}]} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:39:32.144644 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-e8fc8d5e-8b13-4a9b-867e-2c5baca70dd6 req-87c96bee-2816-4437-8da7-ec4398f53c78 service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:39:32.145338 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-e8fc8d5e-8b13-4a9b-867e-2c5baca70dd6 req-87c96bee-2816-4437-8da7-ec4398f53c78 service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:39:32.160460 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.compute.server_external_events [req-e8fc8d5e-8b13-4a9b-867e-2c5baca70dd6 req-87c96bee-2816-4437-8da7-ec4398f53c78 service nova] Creating event network-vif-plugged:a93c27fd-fadb-4f8a-be75-eddb5e3c3921 for instance 446bb786-0ec7-4542-9509-36282d7126c8 on hv-cinder-83563 May 19 21:39:32.165757 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [req-e8fc8d5e-8b13-4a9b-867e-2c5baca70dd6 req-87c96bee-2816-4437-8da7-ec4398f53c78 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120394 May 19 21:39:32.166420 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 365/716] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 21:39:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 21:39:32.719009 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-78738adf-7a0f-4c33-a371-1fa029111899 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:39:32.719516 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-78738adf-7a0f-4c33-a371-1fa029111899 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: 446bb786-0ec7-4542-9509-36282d7126c8] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:39:32.726264 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-78738adf-7a0f-4c33-a371-1fa029111899 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:39:32.726719 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-78738adf-7a0f-4c33-a371-1fa029111899 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:39:32.727502 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-78738adf-7a0f-4c33-a371-1fa029111899 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:39:32.727923 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-78738adf-7a0f-4c33-a371-1fa029111899 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:39:32.867352 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-78738adf-7a0f-4c33-a371-1fa029111899 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:39:32.870303 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:39:32.881063 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-78738adf-7a0f-4c33-a371-1fa029111899 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:39:32.882609 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-78738adf-7a0f-4c33-a371-1fa029111899 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:39:32.883738 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-78738adf-7a0f-4c33-a371-1fa029111899 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8" status: 200 len: 1406 microversion: 2.20 time: 0.169165 May 19 21:39:32.884319 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 352/717] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:39:32 2022] GET /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8 => generated 1406 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:39:33.051290 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-7655d007-123f-47fb-bcee-0cbefdfd3c2c tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:39:33.051884 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-7655d007-123f-47fb-bcee-0cbefdfd3c2c tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] [instance: 19887ef9-2867-4e11-ad73-ad8c2eb0871b] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:39:33.058702 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7655d007-123f-47fb-bcee-0cbefdfd3c2c tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:39:33.059128 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7655d007-123f-47fb-bcee-0cbefdfd3c2c tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:39:33.059914 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7655d007-123f-47fb-bcee-0cbefdfd3c2c tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:39:33.060347 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7655d007-123f-47fb-bcee-0cbefdfd3c2c tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:39:33.275658 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-7655d007-123f-47fb-bcee-0cbefdfd3c2c tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a58f82117ab437cab5607c204c86547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4951b93f86e1485692a4aae7b9ece8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:39:33.284264 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-7655d007-123f-47fb-bcee-0cbefdfd3c2c tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] 10.222.0.65 "GET /compute/v2.1/servers/19887ef9-2867-4e11-ad73-ad8c2eb0871b" status: 200 len: 1267 microversion: 2.1 time: 0.238908 May 19 21:39:33.284837 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 366/718] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:39:33 2022] GET /compute/v2.1/servers/19887ef9-2867-4e11-ad73-ad8c2eb0871b => generated 1267 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:39:33.904108 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-7e89855f-b515-4017-bada-c8c468e66ac1 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:39:33.905038 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-7e89855f-b515-4017-bada-c8c468e66ac1 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: 446bb786-0ec7-4542-9509-36282d7126c8] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:39:33.913557 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-7e89855f-b515-4017-bada-c8c468e66ac1 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:39:33.914013 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-7e89855f-b515-4017-bada-c8c468e66ac1 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:39:33.914807 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-7e89855f-b515-4017-bada-c8c468e66ac1 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:39:33.915233 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-7e89855f-b515-4017-bada-c8c468e66ac1 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:39:34.062376 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-7e89855f-b515-4017-bada-c8c468e66ac1 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:39:34.070846 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-7e89855f-b515-4017-bada-c8c468e66ac1 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:39:34.072349 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-7e89855f-b515-4017-bada-c8c468e66ac1 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:39:34.073465 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-7e89855f-b515-4017-bada-c8c468e66ac1 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8" status: 200 len: 1406 microversion: 2.20 time: 0.174002 May 19 21:39:34.074032 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 353/719] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:39:33 2022] GET /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8 => generated 1406 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:39:34.301370 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-86610495-eae8-4309-bfe0-d0fe4529ba3c tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:39:34.301946 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-86610495-eae8-4309-bfe0-d0fe4529ba3c tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] [instance: 19887ef9-2867-4e11-ad73-ad8c2eb0871b] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:39:34.308806 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-86610495-eae8-4309-bfe0-d0fe4529ba3c tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:39:34.309244 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-86610495-eae8-4309-bfe0-d0fe4529ba3c tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:39:34.310004 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-86610495-eae8-4309-bfe0-d0fe4529ba3c tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:39:34.310466 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-86610495-eae8-4309-bfe0-d0fe4529ba3c tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:39:34.453299 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-86610495-eae8-4309-bfe0-d0fe4529ba3c tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a58f82117ab437cab5607c204c86547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4951b93f86e1485692a4aae7b9ece8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:39:34.461710 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-86610495-eae8-4309-bfe0-d0fe4529ba3c tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] 10.222.0.65 "GET /compute/v2.1/servers/19887ef9-2867-4e11-ad73-ad8c2eb0871b" status: 200 len: 1267 microversion: 2.1 time: 0.164353 May 19 21:39:34.462323 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 367/720] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:39:34 2022] GET /compute/v2.1/servers/19887ef9-2867-4e11-ad73-ad8c2eb0871b => generated 1267 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:39:35.092517 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-9c54f416-ca86-462f-943c-fe8060f51155 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:39:35.093608 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-9c54f416-ca86-462f-943c-fe8060f51155 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: 446bb786-0ec7-4542-9509-36282d7126c8] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:39:35.099997 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-9c54f416-ca86-462f-943c-fe8060f51155 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:39:35.100448 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-9c54f416-ca86-462f-943c-fe8060f51155 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:39:35.101224 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-9c54f416-ca86-462f-943c-fe8060f51155 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:39:35.101665 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-9c54f416-ca86-462f-943c-fe8060f51155 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:39:35.249866 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-9c54f416-ca86-462f-943c-fe8060f51155 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:39:35.260257 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-9c54f416-ca86-462f-943c-fe8060f51155 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:39:35.262037 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-9c54f416-ca86-462f-943c-fe8060f51155 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:39:35.263777 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-9c54f416-ca86-462f-943c-fe8060f51155 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8" status: 200 len: 1599 microversion: 2.20 time: 0.175011 May 19 21:39:35.264563 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 354/721] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:39:35 2022] GET /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8 => generated 1599 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:39:35.289109 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-6f24b988-e44c-4f86-b0dd-663cd88730e1 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:39:35.289964 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-6f24b988-e44c-4f86-b0dd-663cd88730e1 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: 446bb786-0ec7-4542-9509-36282d7126c8] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:39:35.301346 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6f24b988-e44c-4f86-b0dd-663cd88730e1 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:39:35.302143 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6f24b988-e44c-4f86-b0dd-663cd88730e1 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:39:35.303538 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6f24b988-e44c-4f86-b0dd-663cd88730e1 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:39:35.304311 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6f24b988-e44c-4f86-b0dd-663cd88730e1 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:39:35.311909 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:39:35.399755 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-6f24b988-e44c-4f86-b0dd-663cd88730e1 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.117542 May 19 21:39:35.400908 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 368/722] 10.222.0.65 () {60 vars in 1315 bytes} [Thu May 19 21:39:35 2022] GET /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8/os-interface => generated 285 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 21:39:35.479533 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-f8cf7aed-341e-45f2-9ded-b9e7bd017c4c tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:39:35.480173 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-f8cf7aed-341e-45f2-9ded-b9e7bd017c4c tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] [instance: 19887ef9-2867-4e11-ad73-ad8c2eb0871b] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:39:35.487757 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f8cf7aed-341e-45f2-9ded-b9e7bd017c4c tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:39:35.488217 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f8cf7aed-341e-45f2-9ded-b9e7bd017c4c tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:39:35.489166 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f8cf7aed-341e-45f2-9ded-b9e7bd017c4c tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:39:35.489635 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f8cf7aed-341e-45f2-9ded-b9e7bd017c4c tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:39:35.715331 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-f8cf7aed-341e-45f2-9ded-b9e7bd017c4c tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a58f82117ab437cab5607c204c86547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4951b93f86e1485692a4aae7b9ece8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:39:35.724056 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-f8cf7aed-341e-45f2-9ded-b9e7bd017c4c tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] 10.222.0.65 "GET /compute/v2.1/servers/19887ef9-2867-4e11-ad73-ad8c2eb0871b" status: 200 len: 1267 microversion: 2.1 time: 0.248901 May 19 21:39:35.724854 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 355/723] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:39:35 2022] GET /compute/v2.1/servers/19887ef9-2867-4e11-ad73-ad8c2eb0871b => generated 1267 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:39:36.741440 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-b34a0a01-f206-4fa0-b01a-1f265fbca3a8 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:39:36.742002 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-b34a0a01-f206-4fa0-b01a-1f265fbca3a8 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] [instance: 19887ef9-2867-4e11-ad73-ad8c2eb0871b] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:39:36.745371 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [req-f5d34565-8b7d-4ff6-9161-929c1ce2eb23 req-ae145ecb-41d2-4335-b01d-5fcc8708e3dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "446bb786-0ec7-4542-9509-36282d7126c8", "tag": "a93c27fd-fadb-4f8a-be75-eddb5e3c3921"}]} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:39:36.748932 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b34a0a01-f206-4fa0-b01a-1f265fbca3a8 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:39:36.749473 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b34a0a01-f206-4fa0-b01a-1f265fbca3a8 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:39:36.750514 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b34a0a01-f206-4fa0-b01a-1f265fbca3a8 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:39:36.750954 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b34a0a01-f206-4fa0-b01a-1f265fbca3a8 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:39:36.756533 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-f5d34565-8b7d-4ff6-9161-929c1ce2eb23 req-ae145ecb-41d2-4335-b01d-5fcc8708e3dd service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:39:36.756979 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-f5d34565-8b7d-4ff6-9161-929c1ce2eb23 req-ae145ecb-41d2-4335-b01d-5fcc8708e3dd service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:39:36.770838 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.compute.server_external_events [req-f5d34565-8b7d-4ff6-9161-929c1ce2eb23 req-ae145ecb-41d2-4335-b01d-5fcc8708e3dd service nova] Creating event network-changed:a93c27fd-fadb-4f8a-be75-eddb5e3c3921 for instance 446bb786-0ec7-4542-9509-36282d7126c8 on hv-cinder-83563 May 19 21:39:36.776121 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [req-f5d34565-8b7d-4ff6-9161-929c1ce2eb23 req-ae145ecb-41d2-4335-b01d-5fcc8708e3dd service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035632 May 19 21:39:36.777466 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 356/724] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 21:39:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 21:39:36.986591 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-b34a0a01-f206-4fa0-b01a-1f265fbca3a8 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a58f82117ab437cab5607c204c86547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4951b93f86e1485692a4aae7b9ece8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:39:36.996985 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-b34a0a01-f206-4fa0-b01a-1f265fbca3a8 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] 10.222.0.65 "GET /compute/v2.1/servers/19887ef9-2867-4e11-ad73-ad8c2eb0871b" status: 200 len: 1267 microversion: 2.1 time: 0.259511 May 19 21:39:36.998388 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 369/725] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:39:36 2022] GET /compute/v2.1/servers/19887ef9-2867-4e11-ad73-ad8c2eb0871b => generated 1267 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:39:38.015069 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-3baa7464-ca8e-4e8d-8ac5-dd962fc84d82 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:39:38.015777 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-3baa7464-ca8e-4e8d-8ac5-dd962fc84d82 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] [instance: 19887ef9-2867-4e11-ad73-ad8c2eb0871b] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:39:38.018805 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_cell0:SELECT=4 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:39:38.020099 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_cell0:SELECT=12 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:39:38.027721 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-3baa7464-ca8e-4e8d-8ac5-dd962fc84d82 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:39:38.028319 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-3baa7464-ca8e-4e8d-8ac5-dd962fc84d82 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:39:38.029144 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-3baa7464-ca8e-4e8d-8ac5-dd962fc84d82 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:39:38.029563 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-3baa7464-ca8e-4e8d-8ac5-dd962fc84d82 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:39:38.188603 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-3baa7464-ca8e-4e8d-8ac5-dd962fc84d82 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a58f82117ab437cab5607c204c86547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4951b93f86e1485692a4aae7b9ece8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:39:38.201093 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-3baa7464-ca8e-4e8d-8ac5-dd962fc84d82 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] 10.222.0.65 "GET /compute/v2.1/servers/19887ef9-2867-4e11-ad73-ad8c2eb0871b" status: 200 len: 1267 microversion: 2.1 time: 0.189909 May 19 21:39:38.201907 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 357/726] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:39:38 2022] GET /compute/v2.1/servers/19887ef9-2867-4e11-ad73-ad8c2eb0871b => generated 1267 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:39:39.219319 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-25a3f39e-ea24-40f0-849a-0c462c47f429 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:39:39.219935 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-25a3f39e-ea24-40f0-849a-0c462c47f429 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] [instance: 19887ef9-2867-4e11-ad73-ad8c2eb0871b] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:39:39.221756 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell0:SELECT=8 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:39:39.227850 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-25a3f39e-ea24-40f0-849a-0c462c47f429 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:39:39.228292 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-25a3f39e-ea24-40f0-849a-0c462c47f429 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:39:39.229051 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-25a3f39e-ea24-40f0-849a-0c462c47f429 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:39:39.229474 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-25a3f39e-ea24-40f0-849a-0c462c47f429 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:39:39.378177 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-25a3f39e-ea24-40f0-849a-0c462c47f429 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a58f82117ab437cab5607c204c86547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4951b93f86e1485692a4aae7b9ece8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:39:39.386618 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-25a3f39e-ea24-40f0-849a-0c462c47f429 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] 10.222.0.65 "GET /compute/v2.1/servers/19887ef9-2867-4e11-ad73-ad8c2eb0871b" status: 200 len: 1267 microversion: 2.1 time: 0.171236 May 19 21:39:39.387177 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 370/727] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:39:39 2022] GET /compute/v2.1/servers/19887ef9-2867-4e11-ad73-ad8c2eb0871b => generated 1267 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:39:40.405325 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-89c3cc68-c9c2-4962-9971-3a89ea34886b tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:39:40.406217 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-89c3cc68-c9c2-4962-9971-3a89ea34886b tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] [instance: 19887ef9-2867-4e11-ad73-ad8c2eb0871b] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:39:40.413273 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-89c3cc68-c9c2-4962-9971-3a89ea34886b tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:39:40.413717 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-89c3cc68-c9c2-4962-9971-3a89ea34886b tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:39:40.414520 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-89c3cc68-c9c2-4962-9971-3a89ea34886b tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:39:40.414957 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-89c3cc68-c9c2-4962-9971-3a89ea34886b tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:39:40.554801 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-89c3cc68-c9c2-4962-9971-3a89ea34886b tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a58f82117ab437cab5607c204c86547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4951b93f86e1485692a4aae7b9ece8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:39:40.563496 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-89c3cc68-c9c2-4962-9971-3a89ea34886b tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] 10.222.0.65 "GET /compute/v2.1/servers/19887ef9-2867-4e11-ad73-ad8c2eb0871b" status: 200 len: 1267 microversion: 2.1 time: 0.162328 May 19 21:39:40.564079 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 358/728] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:39:40 2022] GET /compute/v2.1/servers/19887ef9-2867-4e11-ad73-ad8c2eb0871b => generated 1267 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:39:41.581040 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-be55632b-b8f6-4f78-ab9f-5a82b3dfee20 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:39:41.581602 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-be55632b-b8f6-4f78-ab9f-5a82b3dfee20 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] [instance: 19887ef9-2867-4e11-ad73-ad8c2eb0871b] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:39:41.588874 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-be55632b-b8f6-4f78-ab9f-5a82b3dfee20 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:39:41.589313 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-be55632b-b8f6-4f78-ab9f-5a82b3dfee20 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:39:41.590071 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-be55632b-b8f6-4f78-ab9f-5a82b3dfee20 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:39:41.590541 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-be55632b-b8f6-4f78-ab9f-5a82b3dfee20 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:39:41.724692 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-be55632b-b8f6-4f78-ab9f-5a82b3dfee20 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a58f82117ab437cab5607c204c86547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4951b93f86e1485692a4aae7b9ece8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:39:41.732802 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-be55632b-b8f6-4f78-ab9f-5a82b3dfee20 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] 10.222.0.65 "GET /compute/v2.1/servers/19887ef9-2867-4e11-ad73-ad8c2eb0871b" status: 200 len: 1267 microversion: 2.1 time: 0.156139 May 19 21:39:41.733366 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 371/729] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:39:41 2022] GET /compute/v2.1/servers/19887ef9-2867-4e11-ad73-ad8c2eb0871b => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:39:42.073848 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [req-7e939b85-e16c-42b6-b20a-b2ca092e3cab req-a64e9081-6e46-4f27-af82-dbd26bd712d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19887ef9-2867-4e11-ad73-ad8c2eb0871b", "name": "network-vif-plugged", "status": "completed", "tag": "1de7b941-4923-4121-aea7-13eb18ac70b9"}]} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:39:42.084160 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-7e939b85-e16c-42b6-b20a-b2ca092e3cab req-a64e9081-6e46-4f27-af82-dbd26bd712d2 service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:39:42.084596 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-7e939b85-e16c-42b6-b20a-b2ca092e3cab req-a64e9081-6e46-4f27-af82-dbd26bd712d2 service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:39:42.097597 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.compute.server_external_events [req-7e939b85-e16c-42b6-b20a-b2ca092e3cab req-a64e9081-6e46-4f27-af82-dbd26bd712d2 service nova] Creating event network-vif-plugged:1de7b941-4923-4121-aea7-13eb18ac70b9 for instance 19887ef9-2867-4e11-ad73-ad8c2eb0871b on hv-cinder-83563 May 19 21:39:42.102451 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [req-7e939b85-e16c-42b6-b20a-b2ca092e3cab req-a64e9081-6e46-4f27-af82-dbd26bd712d2 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032289 May 19 21:39:42.103241 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 359/730] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 21:39:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 21:39:42.750946 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-dd0e3627-04b1-4789-a1c5-e3e035321569 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:39:42.751542 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-dd0e3627-04b1-4789-a1c5-e3e035321569 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] [instance: 19887ef9-2867-4e11-ad73-ad8c2eb0871b] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:39:42.758657 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-dd0e3627-04b1-4789-a1c5-e3e035321569 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:39:42.759110 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-dd0e3627-04b1-4789-a1c5-e3e035321569 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:39:42.759874 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-dd0e3627-04b1-4789-a1c5-e3e035321569 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:39:42.760304 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-dd0e3627-04b1-4789-a1c5-e3e035321569 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:39:42.910658 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-dd0e3627-04b1-4789-a1c5-e3e035321569 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a58f82117ab437cab5607c204c86547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4951b93f86e1485692a4aae7b9ece8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:39:42.918928 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-dd0e3627-04b1-4789-a1c5-e3e035321569 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] 10.222.0.65 "GET /compute/v2.1/servers/19887ef9-2867-4e11-ad73-ad8c2eb0871b" status: 200 len: 1267 microversion: 2.1 time: 0.171761 May 19 21:39:42.919640 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 372/731] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:39:42 2022] GET /compute/v2.1/servers/19887ef9-2867-4e11-ad73-ad8c2eb0871b => generated 1267 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:39:43.940002 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-06517e88-d764-43a9-877e-5a8ae494c53c tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:39:43.940699 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-06517e88-d764-43a9-877e-5a8ae494c53c tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] [instance: 19887ef9-2867-4e11-ad73-ad8c2eb0871b] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:39:43.947454 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-06517e88-d764-43a9-877e-5a8ae494c53c tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:39:43.947903 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-06517e88-d764-43a9-877e-5a8ae494c53c tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:39:43.948675 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-06517e88-d764-43a9-877e-5a8ae494c53c tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:39:43.949106 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-06517e88-d764-43a9-877e-5a8ae494c53c tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:39:44.098263 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-06517e88-d764-43a9-877e-5a8ae494c53c tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a58f82117ab437cab5607c204c86547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4951b93f86e1485692a4aae7b9ece8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:39:44.105999 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-06517e88-d764-43a9-877e-5a8ae494c53c tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] 10.222.0.65 "GET /compute/v2.1/servers/19887ef9-2867-4e11-ad73-ad8c2eb0871b" status: 200 len: 1267 microversion: 2.1 time: 0.172537 May 19 21:39:44.106583 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 360/732] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:39:43 2022] GET /compute/v2.1/servers/19887ef9-2867-4e11-ad73-ad8c2eb0871b => generated 1267 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:39:45.122856 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-98d8c1f2-51fb-4dae-a1c2-718618859f8f tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:39:45.123479 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-98d8c1f2-51fb-4dae-a1c2-718618859f8f tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] [instance: 19887ef9-2867-4e11-ad73-ad8c2eb0871b] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:39:45.130545 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-98d8c1f2-51fb-4dae-a1c2-718618859f8f tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:39:45.130993 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-98d8c1f2-51fb-4dae-a1c2-718618859f8f tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:39:45.131756 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-98d8c1f2-51fb-4dae-a1c2-718618859f8f tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:39:45.133312 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-98d8c1f2-51fb-4dae-a1c2-718618859f8f tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:39:45.281943 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-98d8c1f2-51fb-4dae-a1c2-718618859f8f tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a58f82117ab437cab5607c204c86547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4951b93f86e1485692a4aae7b9ece8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:39:45.289937 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-98d8c1f2-51fb-4dae-a1c2-718618859f8f tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] 10.222.0.65 "GET /compute/v2.1/servers/19887ef9-2867-4e11-ad73-ad8c2eb0871b" status: 200 len: 1453 microversion: 2.1 time: 0.171046 May 19 21:39:45.290667 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 373/733] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:39:45 2022] GET /compute/v2.1/servers/19887ef9-2867-4e11-ad73-ad8c2eb0871b => generated 1453 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:39:45.307019 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-ea9f57c1-a939-46b1-b11e-3a50caee091c tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:39:45.307643 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-ea9f57c1-a939-46b1-b11e-3a50caee091c tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] [instance: 19887ef9-2867-4e11-ad73-ad8c2eb0871b] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:39:45.315051 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ea9f57c1-a939-46b1-b11e-3a50caee091c tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:39:45.315497 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ea9f57c1-a939-46b1-b11e-3a50caee091c tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:39:45.316241 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ea9f57c1-a939-46b1-b11e-3a50caee091c tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:39:45.316673 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ea9f57c1-a939-46b1-b11e-3a50caee091c tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:39:45.467234 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-ea9f57c1-a939-46b1-b11e-3a50caee091c tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a58f82117ab437cab5607c204c86547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4951b93f86e1485692a4aae7b9ece8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:39:45.476002 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-ea9f57c1-a939-46b1-b11e-3a50caee091c tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] 10.222.0.65 "GET /compute/v2.1/servers/19887ef9-2867-4e11-ad73-ad8c2eb0871b" status: 200 len: 1453 microversion: 2.1 time: 0.172776 May 19 21:39:45.476587 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 361/734] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:39:45 2022] GET /compute/v2.1/servers/19887ef9-2867-4e11-ad73-ad8c2eb0871b => generated 1453 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:39:47.549518 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [req-8055b0a4-d6c7-417d-8767-24b1654fc69e req-301e6797-1743-4a9e-b958-84acc8e3c63f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19887ef9-2867-4e11-ad73-ad8c2eb0871b", "tag": "1de7b941-4923-4121-aea7-13eb18ac70b9"}]} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:39:47.558201 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-8055b0a4-d6c7-417d-8767-24b1654fc69e req-301e6797-1743-4a9e-b958-84acc8e3c63f service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:39:47.558679 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-8055b0a4-d6c7-417d-8767-24b1654fc69e req-301e6797-1743-4a9e-b958-84acc8e3c63f service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:39:47.569874 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.compute.server_external_events [req-8055b0a4-d6c7-417d-8767-24b1654fc69e req-301e6797-1743-4a9e-b958-84acc8e3c63f service nova] Creating event network-changed:1de7b941-4923-4121-aea7-13eb18ac70b9 for instance 19887ef9-2867-4e11-ad73-ad8c2eb0871b on hv-cinder-83563 May 19 21:39:47.574979 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [req-8055b0a4-d6c7-417d-8767-24b1654fc69e req-301e6797-1743-4a9e-b958-84acc8e3c63f service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029340 May 19 21:39:47.575798 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 374/735] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 21:39:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 21:39:54.901554 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-43663e0b-4800-481c-b88e-2078c829145a tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:39:54.902302 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-43663e0b-4800-481c-b88e-2078c829145a tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: e51de034-1fec-4513-a375-6b28e6180d82] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:39:54.909145 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-43663e0b-4800-481c-b88e-2078c829145a tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:39:54.909593 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-43663e0b-4800-481c-b88e-2078c829145a tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:39:54.910387 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-43663e0b-4800-481c-b88e-2078c829145a tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:39:54.910816 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-43663e0b-4800-481c-b88e-2078c829145a tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:39:54.999883 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.objects.instance [None req-43663e0b-4800-481c-b88e-2078c829145a tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lazy-loading 'services' on Instance uuid e51de034-1fec-4513-a375-6b28e6180d82 {{(pid=124349) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 21:39:55.076978 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-43663e0b-4800-481c-b88e-2078c829145a tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "DELETE /compute/v2.1/servers/e51de034-1fec-4513-a375-6b28e6180d82/os-volume_attachments/6d6a13c0-0bd8-4fb7-9e87-9f7559e75282" status: 202 len: 0 microversion: 2.1 time: 0.179248 May 19 21:39:55.077731 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 362/736] 10.222.0.65 () {58 vars in 1415 bytes} [Thu May 19 21:39:54 2022] DELETE /compute/v2.1/servers/e51de034-1fec-4513-a375-6b28e6180d82/os-volume_attachments/6d6a13c0-0bd8-4fb7-9e87-9f7559e75282 => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 21:39:55.091825 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-51051028-1c1d-4ae7-b12d-faebeb4e4458 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:39:55.092849 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-51051028-1c1d-4ae7-b12d-faebeb4e4458 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: e51de034-1fec-4513-a375-6b28e6180d82] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:39:55.100240 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-51051028-1c1d-4ae7-b12d-faebeb4e4458 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:39:55.100699 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-51051028-1c1d-4ae7-b12d-faebeb4e4458 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:39:55.101539 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-51051028-1c1d-4ae7-b12d-faebeb4e4458 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:39:55.101966 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-51051028-1c1d-4ae7-b12d-faebeb4e4458 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:39:55.137354 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-51051028-1c1d-4ae7-b12d-faebeb4e4458 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "GET /compute/v2.1/servers/e51de034-1fec-4513-a375-6b28e6180d82/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053034 May 19 21:39:55.137924 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 375/737] 10.222.0.65 () {58 vars in 1301 bytes} [Thu May 19 21:39:55 2022] GET /compute/v2.1/servers/e51de034-1fec-4513-a375-6b28e6180d82/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 21:39:56.151303 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-376cfcc1-d770-418c-9056-259d0fc7f016 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:39:56.152395 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-376cfcc1-d770-418c-9056-259d0fc7f016 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: e51de034-1fec-4513-a375-6b28e6180d82] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:39:56.159655 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-376cfcc1-d770-418c-9056-259d0fc7f016 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:39:56.160103 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-376cfcc1-d770-418c-9056-259d0fc7f016 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:39:56.160868 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-376cfcc1-d770-418c-9056-259d0fc7f016 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:39:56.161299 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-376cfcc1-d770-418c-9056-259d0fc7f016 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:39:56.192082 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-376cfcc1-d770-418c-9056-259d0fc7f016 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "GET /compute/v2.1/servers/e51de034-1fec-4513-a375-6b28e6180d82/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045748 May 19 21:39:56.192640 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 363/738] 10.222.0.65 () {58 vars in 1301 bytes} [Thu May 19 21:39:56 2022] GET /compute/v2.1/servers/e51de034-1fec-4513-a375-6b28e6180d82/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 21:39:56.271873 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-854bf6e7-388a-490b-b38e-aef7569001a0 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:39:56.272447 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-854bf6e7-388a-490b-b38e-aef7569001a0 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: e51de034-1fec-4513-a375-6b28e6180d82] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:39:56.279078 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-854bf6e7-388a-490b-b38e-aef7569001a0 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:39:56.279516 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-854bf6e7-388a-490b-b38e-aef7569001a0 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:39:56.280272 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-854bf6e7-388a-490b-b38e-aef7569001a0 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:39:56.280704 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-854bf6e7-388a-490b-b38e-aef7569001a0 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:39:56.307491 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-854bf6e7-388a-490b-b38e-aef7569001a0 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: e51de034-1fec-4513-a375-6b28e6180d82] Going to try to terminate instance {{(pid=124350) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 21:39:56.396944 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-854bf6e7-388a-490b-b38e-aef7569001a0 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "DELETE /compute/v2.1/servers/e51de034-1fec-4513-a375-6b28e6180d82" status: 204 len: 0 microversion: 2.1 time: 0.128699 May 19 21:39:56.397510 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 376/739] 10.222.0.65 () {58 vars in 1238 bytes} [Thu May 19 21:39:56 2022] DELETE /compute/v2.1/servers/e51de034-1fec-4513-a375-6b28e6180d82 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 21:39:56.408646 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-78ed3edd-2afc-4c93-8afa-b98915d0703e tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:39:56.409213 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-78ed3edd-2afc-4c93-8afa-b98915d0703e tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: e51de034-1fec-4513-a375-6b28e6180d82] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:39:56.415642 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-78ed3edd-2afc-4c93-8afa-b98915d0703e tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:39:56.416055 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-78ed3edd-2afc-4c93-8afa-b98915d0703e tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:39:56.416827 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-78ed3edd-2afc-4c93-8afa-b98915d0703e tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:39:56.417243 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-78ed3edd-2afc-4c93-8afa-b98915d0703e tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:39:56.570896 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-78ed3edd-2afc-4c93-8afa-b98915d0703e tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1589968f375946a38e82ec484afc837f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c62c1f3c54f568abdac37360ab457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:39:56.579559 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-78ed3edd-2afc-4c93-8afa-b98915d0703e tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "GET /compute/v2.1/servers/e51de034-1fec-4513-a375-6b28e6180d82" status: 200 len: 1689 microversion: 2.1 time: 0.175668 May 19 21:39:56.580142 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 364/740] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:39:56 2022] GET /compute/v2.1/servers/e51de034-1fec-4513-a375-6b28e6180d82 => generated 1689 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:39:57.598017 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-a670d50d-586c-4045-80d4-08cb852fa814 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:39:57.598558 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-a670d50d-586c-4045-80d4-08cb852fa814 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: e51de034-1fec-4513-a375-6b28e6180d82] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:39:57.608205 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a670d50d-586c-4045-80d4-08cb852fa814 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:39:57.609001 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a670d50d-586c-4045-80d4-08cb852fa814 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:39:57.609805 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a670d50d-586c-4045-80d4-08cb852fa814 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:39:57.610319 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a670d50d-586c-4045-80d4-08cb852fa814 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:39:57.753217 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-a670d50d-586c-4045-80d4-08cb852fa814 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1589968f375946a38e82ec484afc837f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c62c1f3c54f568abdac37360ab457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:39:57.762602 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-a670d50d-586c-4045-80d4-08cb852fa814 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "GET /compute/v2.1/servers/e51de034-1fec-4513-a375-6b28e6180d82" status: 200 len: 1689 microversion: 2.1 time: 0.169426 May 19 21:39:57.763325 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 377/741] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:39:57 2022] GET /compute/v2.1/servers/e51de034-1fec-4513-a375-6b28e6180d82 => generated 1689 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:39:58.782579 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-c124029d-0b79-4d89-a129-270454a156ac tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:39:58.783198 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-c124029d-0b79-4d89-a129-270454a156ac tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: e51de034-1fec-4513-a375-6b28e6180d82] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:39:58.785700 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_api:SELECT=36 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:39:58.791365 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c124029d-0b79-4d89-a129-270454a156ac tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:39:58.791807 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c124029d-0b79-4d89-a129-270454a156ac tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:39:58.792569 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c124029d-0b79-4d89-a129-270454a156ac tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:39:58.792997 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c124029d-0b79-4d89-a129-270454a156ac tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:39:58.935566 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-c124029d-0b79-4d89-a129-270454a156ac tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1589968f375946a38e82ec484afc837f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c62c1f3c54f568abdac37360ab457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:39:58.944328 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-c124029d-0b79-4d89-a129-270454a156ac tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "GET /compute/v2.1/servers/e51de034-1fec-4513-a375-6b28e6180d82" status: 200 len: 1689 microversion: 2.1 time: 0.167095 May 19 21:39:58.944900 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 365/742] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:39:58 2022] GET /compute/v2.1/servers/e51de034-1fec-4513-a375-6b28e6180d82 => generated 1689 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:39:59.962862 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-f2f5a418-4328-43fb-8741-628b51e41f8e tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:39:59.963470 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-f2f5a418-4328-43fb-8741-628b51e41f8e tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: e51de034-1fec-4513-a375-6b28e6180d82] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:39:59.965881 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:39:59.971449 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f2f5a418-4328-43fb-8741-628b51e41f8e tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:39:59.971895 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f2f5a418-4328-43fb-8741-628b51e41f8e tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:39:59.972664 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f2f5a418-4328-43fb-8741-628b51e41f8e tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:39:59.973098 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f2f5a418-4328-43fb-8741-628b51e41f8e tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:40:00.121434 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-f2f5a418-4328-43fb-8741-628b51e41f8e tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1589968f375946a38e82ec484afc837f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c62c1f3c54f568abdac37360ab457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:40:00.132606 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-f2f5a418-4328-43fb-8741-628b51e41f8e tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "GET /compute/v2.1/servers/e51de034-1fec-4513-a375-6b28e6180d82" status: 200 len: 1689 microversion: 2.1 time: 0.173407 May 19 21:40:00.133361 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 378/743] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:39:59 2022] GET /compute/v2.1/servers/e51de034-1fec-4513-a375-6b28e6180d82 => generated 1689 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:40:01.152713 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-6a71cd16-1236-4453-84d5-5955162323bc tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:40:01.153317 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-6a71cd16-1236-4453-84d5-5955162323bc tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: e51de034-1fec-4513-a375-6b28e6180d82] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:40:01.160348 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-6a71cd16-1236-4453-84d5-5955162323bc tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:40:01.160829 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-6a71cd16-1236-4453-84d5-5955162323bc tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:40:01.161595 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-6a71cd16-1236-4453-84d5-5955162323bc tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:40:01.162028 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-6a71cd16-1236-4453-84d5-5955162323bc tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:40:01.312719 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-6a71cd16-1236-4453-84d5-5955162323bc tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1589968f375946a38e82ec484afc837f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c62c1f3c54f568abdac37360ab457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:40:01.322101 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-6a71cd16-1236-4453-84d5-5955162323bc tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "GET /compute/v2.1/servers/e51de034-1fec-4513-a375-6b28e6180d82" status: 200 len: 1689 microversion: 2.1 time: 0.173112 May 19 21:40:01.322846 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 366/744] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:40:01 2022] GET /compute/v2.1/servers/e51de034-1fec-4513-a375-6b28e6180d82 => generated 1689 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:40:01.604853 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [req-9160ace7-932f-4be3-8c92-285ee136d164 req-f98d9837-7545-4d04-a238-7f8dee814752 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e51de034-1fec-4513-a375-6b28e6180d82", "name": "network-vif-deleted", "tag": "f6476118-5256-4fbe-bbbd-6fb7f8cb02c1"}]} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:40:01.614411 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-9160ace7-932f-4be3-8c92-285ee136d164 req-f98d9837-7545-4d04-a238-7f8dee814752 service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:40:01.614852 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-9160ace7-932f-4be3-8c92-285ee136d164 req-f98d9837-7545-4d04-a238-7f8dee814752 service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:40:01.626951 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.compute.server_external_events [req-9160ace7-932f-4be3-8c92-285ee136d164 req-f98d9837-7545-4d04-a238-7f8dee814752 service nova] Creating event network-vif-deleted:f6476118-5256-4fbe-bbbd-6fb7f8cb02c1 for instance e51de034-1fec-4513-a375-6b28e6180d82 on hv-cinder-83563 May 19 21:40:01.633558 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [req-9160ace7-932f-4be3-8c92-285ee136d164 req-f98d9837-7545-4d04-a238-7f8dee814752 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032010 May 19 21:40:01.634205 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 379/745] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 21:40:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 21:40:02.340396 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-62f03531-fdd5-4fb9-b3b0-5c7b72e02a69 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:40:02.340984 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-62f03531-fdd5-4fb9-b3b0-5c7b72e02a69 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: e51de034-1fec-4513-a375-6b28e6180d82] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:40:02.349505 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-62f03531-fdd5-4fb9-b3b0-5c7b72e02a69 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:40:02.350327 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-62f03531-fdd5-4fb9-b3b0-5c7b72e02a69 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:40:02.351520 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-62f03531-fdd5-4fb9-b3b0-5c7b72e02a69 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:40:02.351970 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-62f03531-fdd5-4fb9-b3b0-5c7b72e02a69 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:40:02.369943 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.wsgi [None req-62f03531-fdd5-4fb9-b3b0-5c7b72e02a69 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] HTTP exception thrown: Instance e51de034-1fec-4513-a375-6b28e6180d82 could not be found. May 19 21:40:02.371686 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-62f03531-fdd5-4fb9-b3b0-5c7b72e02a69 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Request method failure captured: May 19 21:40:02.371686 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: request: GET /compute/v2.1/servers/e51de034-1fec-4513-a375-6b28e6180d82 HTTP/1.1 May 19 21:40:02.371686 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Accept: application/json May 19 21:40:02.371686 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Accept-Encoding: identity May 19 21:40:02.371686 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Connection: close May 19 21:40:02.371686 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Content-Length: 0 May 19 21:40:02.371686 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Content-Type: application/json May 19 21:40:02.371686 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Host: 10.222.0.65 May 19 21:40:02.371686 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Openstack-System-Scope: None May 19 21:40:02.371686 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: User-Agent: python-urllib3/1.26.9 May 19 21:40:02.371686 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Auth-Token: gAAAAABihrdiO8WlYaDIi7If9wZxpwSGzpo12IIIWNH6BfJt71nk5vcpOYqFB3VPd06TTglmiGbN4sYDeZcKhy-4mKZalpEB_LLIlrgRhEAAwCx0bHylpvZxTT7OZ_q99On0cqILTOHkFkDE0bep6C1Ese4EHQeGGDI-xr78VggcJ9wPIAfjlIA May 19 21:40:02.371686 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Domain-Id: None May 19 21:40:02.371686 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Domain-Name: None May 19 21:40:02.371686 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Identity-Status: Confirmed May 19 21:40:02.371686 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Is-Admin-Project: True May 19 21:40:02.371686 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Project-Domain-Id: default May 19 21:40:02.371686 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Project-Domain-Name: Default May 19 21:40:02.371686 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Project-Id: 985c62c1f3c54f568abdac37360ab457 May 19 21:40:02.371686 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-338234618 May 19 21:40:02.371686 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Role: reader,member May 19 21:40:02.371686 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Roles: reader,member May 19 21:40:02.373310 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/985c62c1f3c54f568abdac37360ab457"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/985c62c1f3c54f568abdac37360ab457"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_985c62c1f3c54f568abdac37360ab457"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/985c62c1f3c54f568abdac37360ab457"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}] May 19 21:40:02.373310 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Tenant: tempest-ServerRescueNegativeTestJSON-338234618 May 19 21:40:02.373310 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Tenant-Id: 985c62c1f3c54f568abdac37360ab457 May 19 21:40:02.373310 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-338234618 May 19 21:40:02.373310 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-User: tempest-ServerRescueNegativeTestJSON-338234618-project May 19 21:40:02.373310 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-User-Domain-Id: default May 19 21:40:02.373310 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-User-Domain-Name: Default May 19 21:40:02.373310 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-User-Id: 1589968f375946a38e82ec484afc837f May 19 21:40:02.373310 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-User-Name: tempest-ServerRescueNegativeTestJSON-338234618-project May 19 21:40:02.373310 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: method: > May 19 21:40:02.373310 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: exception: Instance e51de034-1fec-4513-a375-6b28e6180d82 could not be found. May 19 21:40:02.373310 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: action_args: {'id': 'e51de034-1fec-4513-a375-6b28e6180d82'} May 19 21:40:02.374314 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 21:40:02.374314 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:40:02.374314 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 21:40:02.374314 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 21:40:02.374314 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 21:40:02.374314 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 21:40:02.374314 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 21:40:02.374314 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 21:40:02.374314 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 21:40:02.374314 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 21:40:02.374314 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e51de034-1fec-4513-a375-6b28e6180d82 could not be found. May 19 21:40:02.374314 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:40:02.374314 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 21:40:02.374314 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:40:02.374314 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:40:02.374314 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 21:40:02.374314 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 21:40:02.374314 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 21:40:02.374314 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 21:40:02.374314 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 21:40:02.375892 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 21:40:02.375892 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 21:40:02.375892 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 21:40:02.375892 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 21:40:02.375892 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 21:40:02.375892 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 21:40:02.375892 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 21:40:02.375892 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e51de034-1fec-4513-a375-6b28e6180d82 could not be found. May 19 21:40:02.375892 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:40:02.375892 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 21:40:02.375892 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:40:02.375892 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:40:02.375892 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 21:40:02.375892 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 21:40:02.375892 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 21:40:02.375892 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 21:40:02.375892 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e51de034-1fec-4513-a375-6b28e6180d82 could not be found. May 19 21:40:02.375892 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:40:02.377178 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-62f03531-fdd5-4fb9-b3b0-5c7b72e02a69 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Returning 404 to user: Instance e51de034-1fec-4513-a375-6b28e6180d82 could not be found. {{(pid=124349) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 21:40:02.377178 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-62f03531-fdd5-4fb9-b3b0-5c7b72e02a69 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "GET /compute/v2.1/servers/e51de034-1fec-4513-a375-6b28e6180d82" status: 404 len: 111 microversion: 2.1 time: 0.036622 May 19 21:40:02.377178 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 367/746] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:40:02 2022] GET /compute/v2.1/servers/e51de034-1fec-4513-a375-6b28e6180d82 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 21:40:02.382679 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-cdb095d3-0b90-4c44-a59c-b11d208991ab tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Calling method '.version_select at 0x7fe363592700>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:40:02.403431 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-cdb095d3-0b90-4c44-a59c-b11d208991ab tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-102709342" status: 202 len: 0 microversion: 2.1 time: 0.024865 May 19 21:40:02.404262 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 380/747] 10.222.0.65 () {58 vars in 1217 bytes} [Thu May 19 21:40:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-102709342 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 21:40:05.601291 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-df3107a0-8aca-46a3-97c1-26a9c5f4f0e5 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:40:05.601867 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-df3107a0-8aca-46a3-97c1-26a9c5f4f0e5 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:40:05.609595 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-df3107a0-8aca-46a3-97c1-26a9c5f4f0e5 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:40:05.610096 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-df3107a0-8aca-46a3-97c1-26a9c5f4f0e5 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:40:05.610914 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-df3107a0-8aca-46a3-97c1-26a9c5f4f0e5 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:40:05.611337 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-df3107a0-8aca-46a3-97c1-26a9c5f4f0e5 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:40:05.614322 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_cell1:SELECT=83,nova_cell1:INSERT=1 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:40:05.642158 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-df3107a0-8aca-46a3-97c1-26a9c5f4f0e5 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7] Going to try to terminate instance {{(pid=124349) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 21:40:05.727059 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-df3107a0-8aca-46a3-97c1-26a9c5f4f0e5 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "DELETE /compute/v2.1/servers/e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7" status: 204 len: 0 microversion: 2.1 time: 0.129576 May 19 21:40:05.727912 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 368/748] 10.222.0.65 () {58 vars in 1238 bytes} [Thu May 19 21:40:05 2022] DELETE /compute/v2.1/servers/e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 21:40:05.740020 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-4adbc97a-f899-4d5f-9e08-dcb37f5d0fb2 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:40:05.740996 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-4adbc97a-f899-4d5f-9e08-dcb37f5d0fb2 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:40:05.750615 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4adbc97a-f899-4d5f-9e08-dcb37f5d0fb2 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:40:05.751225 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4adbc97a-f899-4d5f-9e08-dcb37f5d0fb2 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:40:05.752045 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4adbc97a-f899-4d5f-9e08-dcb37f5d0fb2 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:40:05.752734 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4adbc97a-f899-4d5f-9e08-dcb37f5d0fb2 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:40:05.763292 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:40:05.908641 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-4adbc97a-f899-4d5f-9e08-dcb37f5d0fb2 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1589968f375946a38e82ec484afc837f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c62c1f3c54f568abdac37360ab457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:40:05.916707 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-4adbc97a-f899-4d5f-9e08-dcb37f5d0fb2 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "GET /compute/v2.1/servers/e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7" status: 200 len: 1509 microversion: 2.1 time: 0.183898 May 19 21:40:05.917282 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 381/749] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:40:05 2022] GET /compute/v2.1/servers/e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7 => generated 1509 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:40:06.935865 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-eb446233-4133-4aae-ab78-71028499e861 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:40:06.936614 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-eb446233-4133-4aae-ab78-71028499e861 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:40:06.943707 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-eb446233-4133-4aae-ab78-71028499e861 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:40:06.944465 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-eb446233-4133-4aae-ab78-71028499e861 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:40:06.945265 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-eb446233-4133-4aae-ab78-71028499e861 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:40:06.945695 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-eb446233-4133-4aae-ab78-71028499e861 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:40:07.134354 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-eb446233-4133-4aae-ab78-71028499e861 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1589968f375946a38e82ec484afc837f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c62c1f3c54f568abdac37360ab457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:40:07.144398 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-eb446233-4133-4aae-ab78-71028499e861 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "GET /compute/v2.1/servers/e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7" status: 200 len: 1509 microversion: 2.1 time: 0.212324 May 19 21:40:07.154325 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 369/750] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:40:06 2022] GET /compute/v2.1/servers/e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7 => generated 1509 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:40:07.206414 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [req-78fa1048-6036-4a5d-a8a9-02dc6f1f7de4 req-f7da66cd-8b13-4337-8903-03ef0f932a5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7", "name": "network-vif-deleted", "tag": "7339e736-ece9-44ac-91e7-0467d6624578"}]} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:40:07.216704 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-78fa1048-6036-4a5d-a8a9-02dc6f1f7de4 req-f7da66cd-8b13-4337-8903-03ef0f932a5b service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:40:07.217137 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-78fa1048-6036-4a5d-a8a9-02dc6f1f7de4 req-f7da66cd-8b13-4337-8903-03ef0f932a5b service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:40:07.229095 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.compute.server_external_events [req-78fa1048-6036-4a5d-a8a9-02dc6f1f7de4 req-f7da66cd-8b13-4337-8903-03ef0f932a5b service nova] Creating event network-vif-deleted:7339e736-ece9-44ac-91e7-0467d6624578 for instance e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7 on hv-cinder-83563 May 19 21:40:07.234780 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [req-78fa1048-6036-4a5d-a8a9-02dc6f1f7de4 req-f7da66cd-8b13-4337-8903-03ef0f932a5b service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032133 May 19 21:40:07.235380 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 382/751] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 21:40:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 21:40:08.162848 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-180fd02e-b156-4342-bb22-ee7ebea20662 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:40:08.163429 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-180fd02e-b156-4342-bb22-ee7ebea20662 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:40:08.170499 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-180fd02e-b156-4342-bb22-ee7ebea20662 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:40:08.171029 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-180fd02e-b156-4342-bb22-ee7ebea20662 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:40:08.171791 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-180fd02e-b156-4342-bb22-ee7ebea20662 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:40:08.172214 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-180fd02e-b156-4342-bb22-ee7ebea20662 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:40:08.186080 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.wsgi [None req-180fd02e-b156-4342-bb22-ee7ebea20662 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] HTTP exception thrown: Instance e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7 could not be found. May 19 21:40:08.187780 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-180fd02e-b156-4342-bb22-ee7ebea20662 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Request method failure captured: May 19 21:40:08.187780 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: request: GET /compute/v2.1/servers/e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7 HTTP/1.1 May 19 21:40:08.187780 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Accept: application/json May 19 21:40:08.187780 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Accept-Encoding: identity May 19 21:40:08.187780 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Connection: close May 19 21:40:08.187780 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Content-Length: 0 May 19 21:40:08.187780 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Content-Type: application/json May 19 21:40:08.187780 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Host: 10.222.0.65 May 19 21:40:08.187780 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Openstack-System-Scope: None May 19 21:40:08.187780 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: User-Agent: python-urllib3/1.26.9 May 19 21:40:08.187780 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Auth-Token: gAAAAABihrdiO8WlYaDIi7If9wZxpwSGzpo12IIIWNH6BfJt71nk5vcpOYqFB3VPd06TTglmiGbN4sYDeZcKhy-4mKZalpEB_LLIlrgRhEAAwCx0bHylpvZxTT7OZ_q99On0cqILTOHkFkDE0bep6C1Ese4EHQeGGDI-xr78VggcJ9wPIAfjlIA May 19 21:40:08.187780 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Domain-Id: None May 19 21:40:08.187780 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Domain-Name: None May 19 21:40:08.187780 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Identity-Status: Confirmed May 19 21:40:08.187780 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Is-Admin-Project: True May 19 21:40:08.187780 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Project-Domain-Id: default May 19 21:40:08.187780 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Project-Domain-Name: Default May 19 21:40:08.187780 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Project-Id: 985c62c1f3c54f568abdac37360ab457 May 19 21:40:08.187780 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-338234618 May 19 21:40:08.187780 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Role: reader,member May 19 21:40:08.187780 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Roles: reader,member May 19 21:40:08.189107 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/985c62c1f3c54f568abdac37360ab457"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/985c62c1f3c54f568abdac37360ab457"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_985c62c1f3c54f568abdac37360ab457"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/985c62c1f3c54f568abdac37360ab457"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}] May 19 21:40:08.189107 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Tenant: tempest-ServerRescueNegativeTestJSON-338234618 May 19 21:40:08.189107 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Tenant-Id: 985c62c1f3c54f568abdac37360ab457 May 19 21:40:08.189107 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-338234618 May 19 21:40:08.189107 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-User: tempest-ServerRescueNegativeTestJSON-338234618-project May 19 21:40:08.189107 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-User-Domain-Id: default May 19 21:40:08.189107 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-User-Domain-Name: Default May 19 21:40:08.189107 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-User-Id: 1589968f375946a38e82ec484afc837f May 19 21:40:08.189107 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-User-Name: tempest-ServerRescueNegativeTestJSON-338234618-project May 19 21:40:08.189107 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: method: > May 19 21:40:08.189107 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: exception: Instance e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7 could not be found. May 19 21:40:08.189107 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: action_args: {'id': 'e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7'} May 19 21:40:08.189833 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 21:40:08.189833 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:40:08.189833 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 21:40:08.189833 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 21:40:08.189833 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 21:40:08.189833 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 21:40:08.189833 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 21:40:08.189833 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 21:40:08.189833 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 21:40:08.189833 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 21:40:08.189833 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7 could not be found. May 19 21:40:08.189833 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:40:08.189833 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 21:40:08.189833 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:40:08.189833 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:40:08.189833 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 21:40:08.189833 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 21:40:08.189833 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 21:40:08.189833 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 21:40:08.189833 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 21:40:08.191334 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 21:40:08.191334 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 21:40:08.191334 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 21:40:08.191334 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 21:40:08.191334 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 21:40:08.191334 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 21:40:08.191334 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 21:40:08.191334 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7 could not be found. May 19 21:40:08.191334 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:40:08.191334 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 21:40:08.191334 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:40:08.191334 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:40:08.191334 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 21:40:08.191334 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 21:40:08.191334 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 21:40:08.191334 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 21:40:08.191334 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7 could not be found. May 19 21:40:08.191334 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:40:08.192965 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-180fd02e-b156-4342-bb22-ee7ebea20662 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Returning 404 to user: Instance e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7 could not be found. {{(pid=124349) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 21:40:08.192965 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-180fd02e-b156-4342-bb22-ee7ebea20662 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "GET /compute/v2.1/servers/e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7" status: 404 len: 111 microversion: 2.1 time: 0.030286 May 19 21:40:08.192965 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 370/752] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:40:08 2022] GET /compute/v2.1/servers/e7eab2a3-aa70-47f6-ad8b-6d2f8b0311a7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 21:40:08.198557 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-fa84e3f9-8d34-4586-b78e-a2bfe4af69ec tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:40:08.199145 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-fa84e3f9-8d34-4586-b78e-a2bfe4af69ec tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: a18b9269-6ed1-4af1-a0da-8260f38fbf39] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:40:08.206004 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-fa84e3f9-8d34-4586-b78e-a2bfe4af69ec tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:40:08.206490 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-fa84e3f9-8d34-4586-b78e-a2bfe4af69ec tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:40:08.207258 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-fa84e3f9-8d34-4586-b78e-a2bfe4af69ec tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:40:08.207690 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-fa84e3f9-8d34-4586-b78e-a2bfe4af69ec tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:40:08.235281 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-fa84e3f9-8d34-4586-b78e-a2bfe4af69ec tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: a18b9269-6ed1-4af1-a0da-8260f38fbf39] Going to try to terminate instance {{(pid=124350) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 21:40:08.333025 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-fa84e3f9-8d34-4586-b78e-a2bfe4af69ec tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "DELETE /compute/v2.1/servers/a18b9269-6ed1-4af1-a0da-8260f38fbf39" status: 204 len: 0 microversion: 2.1 time: 0.138524 May 19 21:40:08.333655 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 383/753] 10.222.0.65 () {58 vars in 1238 bytes} [Thu May 19 21:40:08 2022] DELETE /compute/v2.1/servers/a18b9269-6ed1-4af1-a0da-8260f38fbf39 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 21:40:08.341795 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-ae85eb8f-179c-446f-8df2-28debbbaf78d tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:40:08.342436 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-ae85eb8f-179c-446f-8df2-28debbbaf78d tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: a18b9269-6ed1-4af1-a0da-8260f38fbf39] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:40:08.349233 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ae85eb8f-179c-446f-8df2-28debbbaf78d tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:40:08.349674 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ae85eb8f-179c-446f-8df2-28debbbaf78d tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:40:08.350486 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ae85eb8f-179c-446f-8df2-28debbbaf78d tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:40:08.350923 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ae85eb8f-179c-446f-8df2-28debbbaf78d tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:40:08.499955 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-ae85eb8f-179c-446f-8df2-28debbbaf78d tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1589968f375946a38e82ec484afc837f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c62c1f3c54f568abdac37360ab457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:40:08.508175 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-ae85eb8f-179c-446f-8df2-28debbbaf78d tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "GET /compute/v2.1/servers/a18b9269-6ed1-4af1-a0da-8260f38fbf39" status: 200 len: 1523 microversion: 2.1 time: 0.170180 May 19 21:40:08.508761 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 371/754] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:40:08 2022] GET /compute/v2.1/servers/a18b9269-6ed1-4af1-a0da-8260f38fbf39 => generated 1523 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:40:09.528486 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-335add25-b395-4bfe-bfab-c8f220bb5da0 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:40:09.529206 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-335add25-b395-4bfe-bfab-c8f220bb5da0 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: a18b9269-6ed1-4af1-a0da-8260f38fbf39] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:40:09.540672 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-335add25-b395-4bfe-bfab-c8f220bb5da0 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:40:09.541171 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-335add25-b395-4bfe-bfab-c8f220bb5da0 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:40:09.541893 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-335add25-b395-4bfe-bfab-c8f220bb5da0 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:40:09.542355 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-335add25-b395-4bfe-bfab-c8f220bb5da0 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:40:09.649939 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-335add25-b395-4bfe-bfab-c8f220bb5da0 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1589968f375946a38e82ec484afc837f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c62c1f3c54f568abdac37360ab457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:40:09.660201 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-335add25-b395-4bfe-bfab-c8f220bb5da0 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "GET /compute/v2.1/servers/a18b9269-6ed1-4af1-a0da-8260f38fbf39" status: 200 len: 1481 microversion: 2.1 time: 0.137350 May 19 21:40:09.669911 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [req-8e6f93c9-1b0e-40f5-9e2b-224f576e4333 req-d40cc66b-8d08-43ee-bf14-e90147701642 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a18b9269-6ed1-4af1-a0da-8260f38fbf39", "name": "network-vif-deleted", "tag": "7e0ac86c-4227-4467-92ca-7b8942e9f54c"}]} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:40:09.671030 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 384/755] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:40:09 2022] GET /compute/v2.1/servers/a18b9269-6ed1-4af1-a0da-8260f38fbf39 => generated 1481 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:40:09.673629 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-8e6f93c9-1b0e-40f5-9e2b-224f576e4333 req-d40cc66b-8d08-43ee-bf14-e90147701642 service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:40:09.674183 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-8e6f93c9-1b0e-40f5-9e2b-224f576e4333 req-d40cc66b-8d08-43ee-bf14-e90147701642 service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:40:09.687048 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.compute.server_external_events [req-8e6f93c9-1b0e-40f5-9e2b-224f576e4333 req-d40cc66b-8d08-43ee-bf14-e90147701642 service nova] Creating event network-vif-deleted:7e0ac86c-4227-4467-92ca-7b8942e9f54c for instance a18b9269-6ed1-4af1-a0da-8260f38fbf39 on hv-cinder-83563 May 19 21:40:09.692636 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [req-8e6f93c9-1b0e-40f5-9e2b-224f576e4333 req-d40cc66b-8d08-43ee-bf14-e90147701642 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032191 May 19 21:40:09.693364 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 372/756] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 21:40:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 21:40:10.681460 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-d738c204-b9c5-4cb5-bbfc-cfdc82a27168 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:40:10.682072 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-d738c204-b9c5-4cb5-bbfc-cfdc82a27168 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] [instance: a18b9269-6ed1-4af1-a0da-8260f38fbf39] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:40:10.690143 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d738c204-b9c5-4cb5-bbfc-cfdc82a27168 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:40:10.690598 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d738c204-b9c5-4cb5-bbfc-cfdc82a27168 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:40:10.691382 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d738c204-b9c5-4cb5-bbfc-cfdc82a27168 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:40:10.691815 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d738c204-b9c5-4cb5-bbfc-cfdc82a27168 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:40:10.705926 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.wsgi [None req-d738c204-b9c5-4cb5-bbfc-cfdc82a27168 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] HTTP exception thrown: Instance a18b9269-6ed1-4af1-a0da-8260f38fbf39 could not be found. May 19 21:40:10.707627 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-d738c204-b9c5-4cb5-bbfc-cfdc82a27168 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Request method failure captured: May 19 21:40:10.707627 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: request: GET /compute/v2.1/servers/a18b9269-6ed1-4af1-a0da-8260f38fbf39 HTTP/1.1 May 19 21:40:10.707627 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Accept: application/json May 19 21:40:10.707627 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Accept-Encoding: identity May 19 21:40:10.707627 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Connection: close May 19 21:40:10.707627 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Content-Length: 0 May 19 21:40:10.707627 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Content-Type: application/json May 19 21:40:10.707627 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Host: 10.222.0.65 May 19 21:40:10.707627 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Openstack-System-Scope: None May 19 21:40:10.707627 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: User-Agent: python-urllib3/1.26.9 May 19 21:40:10.707627 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Auth-Token: gAAAAABihrdiO8WlYaDIi7If9wZxpwSGzpo12IIIWNH6BfJt71nk5vcpOYqFB3VPd06TTglmiGbN4sYDeZcKhy-4mKZalpEB_LLIlrgRhEAAwCx0bHylpvZxTT7OZ_q99On0cqILTOHkFkDE0bep6C1Ese4EHQeGGDI-xr78VggcJ9wPIAfjlIA May 19 21:40:10.707627 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Domain-Id: None May 19 21:40:10.707627 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Domain-Name: None May 19 21:40:10.707627 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Identity-Status: Confirmed May 19 21:40:10.707627 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Is-Admin-Project: True May 19 21:40:10.707627 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Project-Domain-Id: default May 19 21:40:10.707627 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Project-Domain-Name: Default May 19 21:40:10.707627 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Project-Id: 985c62c1f3c54f568abdac37360ab457 May 19 21:40:10.707627 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-338234618 May 19 21:40:10.707627 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Role: reader,member May 19 21:40:10.707627 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Roles: reader,member May 19 21:40:10.709122 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/985c62c1f3c54f568abdac37360ab457"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/985c62c1f3c54f568abdac37360ab457"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_985c62c1f3c54f568abdac37360ab457"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/985c62c1f3c54f568abdac37360ab457"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}] May 19 21:40:10.709122 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Tenant: tempest-ServerRescueNegativeTestJSON-338234618 May 19 21:40:10.709122 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Tenant-Id: 985c62c1f3c54f568abdac37360ab457 May 19 21:40:10.709122 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-338234618 May 19 21:40:10.709122 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-User: tempest-ServerRescueNegativeTestJSON-338234618-project May 19 21:40:10.709122 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-User-Domain-Id: default May 19 21:40:10.709122 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-User-Domain-Name: Default May 19 21:40:10.709122 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-User-Id: 1589968f375946a38e82ec484afc837f May 19 21:40:10.709122 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-User-Name: tempest-ServerRescueNegativeTestJSON-338234618-project May 19 21:40:10.709122 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: method: > May 19 21:40:10.709122 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: exception: Instance a18b9269-6ed1-4af1-a0da-8260f38fbf39 could not be found. May 19 21:40:10.709122 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: action_args: {'id': 'a18b9269-6ed1-4af1-a0da-8260f38fbf39'} May 19 21:40:10.709969 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 21:40:10.709969 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:40:10.709969 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 21:40:10.709969 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 21:40:10.709969 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 21:40:10.709969 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 21:40:10.709969 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 21:40:10.709969 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 21:40:10.709969 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 21:40:10.709969 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 21:40:10.709969 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a18b9269-6ed1-4af1-a0da-8260f38fbf39 could not be found. May 19 21:40:10.709969 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi May 19 21:40:10.709969 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 21:40:10.709969 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi May 19 21:40:10.709969 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:40:10.709969 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 21:40:10.709969 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 21:40:10.709969 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 21:40:10.709969 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 21:40:10.709969 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 21:40:10.711380 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 21:40:10.711380 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 21:40:10.711380 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 21:40:10.711380 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 21:40:10.711380 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 21:40:10.711380 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 21:40:10.711380 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 21:40:10.711380 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a18b9269-6ed1-4af1-a0da-8260f38fbf39 could not be found. May 19 21:40:10.711380 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi May 19 21:40:10.711380 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 21:40:10.711380 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi May 19 21:40:10.711380 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:40:10.711380 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 21:40:10.711380 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 21:40:10.711380 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 21:40:10.711380 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 21:40:10.711380 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a18b9269-6ed1-4af1-a0da-8260f38fbf39 could not be found. May 19 21:40:10.711380 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi May 19 21:40:10.712662 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-d738c204-b9c5-4cb5-bbfc-cfdc82a27168 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] Returning 404 to user: Instance a18b9269-6ed1-4af1-a0da-8260f38fbf39 could not be found. {{(pid=124350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 21:40:10.712662 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-d738c204-b9c5-4cb5-bbfc-cfdc82a27168 tempest-ServerRescueNegativeTestJSON-338234618 tempest-ServerRescueNegativeTestJSON-338234618-project] 10.222.0.65 "GET /compute/v2.1/servers/a18b9269-6ed1-4af1-a0da-8260f38fbf39" status: 404 len: 111 microversion: 2.1 time: 0.033955 May 19 21:40:10.712662 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 385/757] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:40:10 2022] GET /compute/v2.1/servers/a18b9269-6ed1-4af1-a0da-8260f38fbf39 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 21:40:15.694114 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-a485a20a-f589-4ff4-9784-c96284966458 tempest-VolumesNegativeTest-260587248 tempest-VolumesNegativeTest-260587248-project] Action: 'create', calling method: .version_select at 0x7fe363466430>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1392075255", "metadata": {"Type": "work"}}} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:40:15.712123 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-a485a20a-f589-4ff4-9784-c96284966458 tempest-VolumesNegativeTest-260587248 tempest-VolumesNegativeTest-260587248-project] Request method failure captured: May 19 21:40:15.712123 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 19 21:40:15.712123 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Accept: application/json May 19 21:40:15.712123 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Accept-Encoding: identity May 19 21:40:15.712123 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Connection: close May 19 21:40:15.712123 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Content-Length: 122 May 19 21:40:15.712123 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Content-Type: application/json May 19 21:40:15.712123 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Host: 10.222.0.65 May 19 21:40:15.712123 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Openstack-System-Scope: None May 19 21:40:15.712123 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: User-Agent: python-urllib3/1.26.9 May 19 21:40:15.712123 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Auth-Token: gAAAAABihrk_spkeglVSGi7hxg3q1ztkvmK2h0syn0yIMjuOXjGINLST24iZhZyYbdlyK7GFVYtJh8ldVXfuVVZ2hO46QMNhTsmMUhYu1ZyW3avsnln5WvO077zuI9PNUtabzoHseb_9AAnpEqI6InJIBonOipqDtRu0Ry-3CQ-utugqRZQmbz0 May 19 21:40:15.712123 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Domain-Id: None May 19 21:40:15.712123 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Domain-Name: None May 19 21:40:15.712123 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Identity-Status: Confirmed May 19 21:40:15.712123 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Is-Admin-Project: True May 19 21:40:15.712123 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Project-Domain-Id: default May 19 21:40:15.712123 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Project-Domain-Name: Default May 19 21:40:15.712123 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Project-Id: c15dc44be00b47b2851f9778d0babe3e May 19 21:40:15.712123 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Project-Name: tempest-VolumesNegativeTest-260587248 May 19 21:40:15.712123 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Role: reader,member May 19 21:40:15.712123 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Roles: reader,member May 19 21:40:15.714545 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/c15dc44be00b47b2851f9778d0babe3e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/c15dc44be00b47b2851f9778d0babe3e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_c15dc44be00b47b2851f9778d0babe3e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/c15dc44be00b47b2851f9778d0babe3e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}] May 19 21:40:15.714545 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Tenant: tempest-VolumesNegativeTest-260587248 May 19 21:40:15.714545 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Tenant-Id: c15dc44be00b47b2851f9778d0babe3e May 19 21:40:15.714545 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Tenant-Name: tempest-VolumesNegativeTest-260587248 May 19 21:40:15.714545 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-User: tempest-VolumesNegativeTest-260587248-project May 19 21:40:15.714545 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-User-Domain-Id: default May 19 21:40:15.714545 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-User-Domain-Name: Default May 19 21:40:15.714545 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-User-Id: 03ccb0fbb7ce42c0a71bbd7e604bb743 May 19 21:40:15.714545 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-User-Name: tempest-VolumesNegativeTest-260587248-project May 19 21:40:15.714545 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: May 19 21:40:15.714545 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1392075255", "metadata": {"Type": "work"}}} May 19 21:40:15.714545 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: method: May 19 21:40:15.714545 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 19 21:40:15.716036 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1392075255', 'metadata': {'Type': 'work'}}}} May 19 21:40:15.716036 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 21:40:15.716036 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:40:15.716036 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 19 21:40:15.716036 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 19 21:40:15.716036 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 19 21:40:15.716036 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise error May 19 21:40:15.716036 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' May 19 21:40:15.716036 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:40:15.716036 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 19 21:40:15.716036 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 19 21:40:15.716036 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:40:15.716036 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi On instance['volume']: May 19 21:40:15.716036 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi '#$%' May 19 21:40:15.716036 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:40:15.716036 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 21:40:15.716036 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:40:15.716036 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:40:15.716036 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 21:40:15.716036 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 21:40:15.716036 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 21:40:15.716036 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 21:40:15.718649 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 21:40:15.718649 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 21:40:15.718649 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 21:40:15.718649 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 21:40:15.718649 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 19 21:40:15.718649 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 19 21:40:15.718649 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 19 21:40:15.718649 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 19 21:40:15.718649 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 19 21:40:15.718649 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 19 21:40:15.718649 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 19 21:40:15.718649 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:40:15.718649 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 21:40:15.718649 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:40:15.718649 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:40:15.718649 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 21:40:15.718649 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 21:40:15.718649 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 19 21:40:15.718649 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 19 21:40:15.720712 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 19 21:40:15.720712 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:40:15.720712 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-a485a20a-f589-4ff4-9784-c96284966458 tempest-VolumesNegativeTest-260587248 tempest-VolumesNegativeTest-260587248-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=124349) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 21:40:15.720712 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-a485a20a-f589-4ff4-9784-c96284966458 tempest-VolumesNegativeTest-260587248 tempest-VolumesNegativeTest-260587248-project] 10.222.0.65 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.162714 May 19 21:40:15.720712 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 373/758] 10.222.0.65 () {60 vars in 1155 bytes} [Thu May 19 21:40:15 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 164 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 19 21:40:15.728507 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-e3a22c58-594f-40f7-b8fd-c7e40a056f2c tempest-VolumesNegativeTest-260587248 tempest-VolumesNegativeTest-260587248-project] Action: 'create', calling method: .version_select at 0x7fe3636caaf0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-226128185", "metadata": {"Type": "work"}}} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:40:15.735267 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-e3a22c58-594f-40f7-b8fd-c7e40a056f2c tempest-VolumesNegativeTest-260587248 tempest-VolumesNegativeTest-260587248-project] Request method failure captured: May 19 21:40:15.735267 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 19 21:40:15.735267 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Accept: application/json May 19 21:40:15.735267 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Accept-Encoding: identity May 19 21:40:15.735267 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Connection: close May 19 21:40:15.735267 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Content-Length: 119 May 19 21:40:15.735267 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Content-Type: application/json May 19 21:40:15.735267 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Host: 10.222.0.65 May 19 21:40:15.735267 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Openstack-System-Scope: None May 19 21:40:15.735267 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: User-Agent: python-urllib3/1.26.9 May 19 21:40:15.735267 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Auth-Token: gAAAAABihrk_spkeglVSGi7hxg3q1ztkvmK2h0syn0yIMjuOXjGINLST24iZhZyYbdlyK7GFVYtJh8ldVXfuVVZ2hO46QMNhTsmMUhYu1ZyW3avsnln5WvO077zuI9PNUtabzoHseb_9AAnpEqI6InJIBonOipqDtRu0Ry-3CQ-utugqRZQmbz0 May 19 21:40:15.735267 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Domain-Id: None May 19 21:40:15.735267 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Domain-Name: None May 19 21:40:15.735267 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Identity-Status: Confirmed May 19 21:40:15.735267 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Is-Admin-Project: True May 19 21:40:15.735267 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Project-Domain-Id: default May 19 21:40:15.735267 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Project-Domain-Name: Default May 19 21:40:15.735267 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Project-Id: c15dc44be00b47b2851f9778d0babe3e May 19 21:40:15.735267 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Project-Name: tempest-VolumesNegativeTest-260587248 May 19 21:40:15.735267 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Role: reader,member May 19 21:40:15.735267 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Roles: reader,member May 19 21:40:15.736774 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/c15dc44be00b47b2851f9778d0babe3e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/c15dc44be00b47b2851f9778d0babe3e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_c15dc44be00b47b2851f9778d0babe3e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/c15dc44be00b47b2851f9778d0babe3e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}] May 19 21:40:15.736774 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Tenant: tempest-VolumesNegativeTest-260587248 May 19 21:40:15.736774 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Tenant-Id: c15dc44be00b47b2851f9778d0babe3e May 19 21:40:15.736774 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Tenant-Name: tempest-VolumesNegativeTest-260587248 May 19 21:40:15.736774 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-User: tempest-VolumesNegativeTest-260587248-project May 19 21:40:15.736774 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-User-Domain-Id: default May 19 21:40:15.736774 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-User-Domain-Name: Default May 19 21:40:15.736774 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-User-Id: 03ccb0fbb7ce42c0a71bbd7e604bb743 May 19 21:40:15.736774 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-User-Name: tempest-VolumesNegativeTest-260587248-project May 19 21:40:15.736774 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: May 19 21:40:15.736774 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-226128185", "metadata": {"Type": "work"}}} May 19 21:40:15.736774 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: method: May 19 21:40:15.736774 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 19 21:40:15.737691 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-226128185', 'metadata': {'Type': 'work'}}}} May 19 21:40:15.737691 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 21:40:15.737691 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:40:15.737691 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 19 21:40:15.737691 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 19 21:40:15.737691 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 19 21:40:15.737691 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise error May 19 21:40:15.737691 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 May 19 21:40:15.737691 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi May 19 21:40:15.737691 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: May 19 21:40:15.737691 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 19 21:40:15.737691 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi May 19 21:40:15.737691 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi On instance['volume']: May 19 21:40:15.737691 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi '0' May 19 21:40:15.737691 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi May 19 21:40:15.737691 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 21:40:15.737691 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi May 19 21:40:15.737691 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:40:15.737691 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 21:40:15.737691 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 21:40:15.737691 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 21:40:15.737691 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 21:40:15.739239 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 21:40:15.739239 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 21:40:15.739239 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 21:40:15.739239 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 21:40:15.739239 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 19 21:40:15.739239 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 19 21:40:15.739239 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 19 21:40:15.739239 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 19 21:40:15.739239 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 19 21:40:15.739239 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 19 21:40:15.739239 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 19 21:40:15.739239 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi May 19 21:40:15.739239 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 21:40:15.739239 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi May 19 21:40:15.739239 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:40:15.739239 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 21:40:15.739239 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 21:40:15.739239 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 19 21:40:15.739239 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 19 21:40:15.740503 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 19 21:40:15.740503 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi May 19 21:40:15.740503 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-e3a22c58-594f-40f7-b8fd-c7e40a056f2c tempest-VolumesNegativeTest-260587248 tempest-VolumesNegativeTest-260587248-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=124350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 21:40:15.740503 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-e3a22c58-594f-40f7-b8fd-c7e40a056f2c tempest-VolumesNegativeTest-260587248 tempest-VolumesNegativeTest-260587248-project] 10.222.0.65 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.016244 May 19 21:40:15.740503 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 386/759] 10.222.0.65 () {60 vars in 1155 bytes} [Thu May 19 21:40:15 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 19 21:40:15.751213 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-b48d0239-92e8-4e2d-94d7-c939bd3d3979 tempest-VolumesNegativeTest-260587248 tempest-VolumesNegativeTest-260587248-project] Action: 'create', calling method: .version_select at 0x7fe36349fdc0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1880149097", "metadata": {"Type": "work"}}} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:40:15.754483 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-b48d0239-92e8-4e2d-94d7-c939bd3d3979 tempest-VolumesNegativeTest-260587248 tempest-VolumesNegativeTest-260587248-project] Request method failure captured: May 19 21:40:15.754483 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 19 21:40:15.754483 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Accept: application/json May 19 21:40:15.754483 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Accept-Encoding: identity May 19 21:40:15.754483 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Connection: close May 19 21:40:15.754483 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Content-Length: 119 May 19 21:40:15.754483 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Content-Type: application/json May 19 21:40:15.754483 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Host: 10.222.0.65 May 19 21:40:15.754483 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Openstack-System-Scope: None May 19 21:40:15.754483 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: User-Agent: python-urllib3/1.26.9 May 19 21:40:15.754483 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Auth-Token: gAAAAABihrk_spkeglVSGi7hxg3q1ztkvmK2h0syn0yIMjuOXjGINLST24iZhZyYbdlyK7GFVYtJh8ldVXfuVVZ2hO46QMNhTsmMUhYu1ZyW3avsnln5WvO077zuI9PNUtabzoHseb_9AAnpEqI6InJIBonOipqDtRu0Ry-3CQ-utugqRZQmbz0 May 19 21:40:15.754483 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Domain-Id: None May 19 21:40:15.754483 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Domain-Name: None May 19 21:40:15.754483 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Identity-Status: Confirmed May 19 21:40:15.754483 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Is-Admin-Project: True May 19 21:40:15.754483 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Project-Domain-Id: default May 19 21:40:15.754483 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Project-Domain-Name: Default May 19 21:40:15.754483 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Project-Id: c15dc44be00b47b2851f9778d0babe3e May 19 21:40:15.754483 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Project-Name: tempest-VolumesNegativeTest-260587248 May 19 21:40:15.754483 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Role: reader,member May 19 21:40:15.754483 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Roles: reader,member May 19 21:40:15.756766 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/c15dc44be00b47b2851f9778d0babe3e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/c15dc44be00b47b2851f9778d0babe3e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_c15dc44be00b47b2851f9778d0babe3e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/c15dc44be00b47b2851f9778d0babe3e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}] May 19 21:40:15.756766 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Tenant: tempest-VolumesNegativeTest-260587248 May 19 21:40:15.756766 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Tenant-Id: c15dc44be00b47b2851f9778d0babe3e May 19 21:40:15.756766 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Tenant-Name: tempest-VolumesNegativeTest-260587248 May 19 21:40:15.756766 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-User: tempest-VolumesNegativeTest-260587248-project May 19 21:40:15.756766 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-User-Domain-Id: default May 19 21:40:15.756766 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-User-Domain-Name: Default May 19 21:40:15.756766 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-User-Id: 03ccb0fbb7ce42c0a71bbd7e604bb743 May 19 21:40:15.756766 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-User-Name: tempest-VolumesNegativeTest-260587248-project May 19 21:40:15.756766 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: May 19 21:40:15.756766 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1880149097", "metadata": {"Type": "work"}}} May 19 21:40:15.756766 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: method: May 19 21:40:15.756766 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 19 21:40:15.758152 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1880149097', 'metadata': {'Type': 'work'}}}} May 19 21:40:15.758152 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 21:40:15.758152 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:40:15.758152 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 19 21:40:15.758152 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 19 21:40:15.758152 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 19 21:40:15.758152 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise error May 19 21:40:15.758152 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' May 19 21:40:15.758152 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:40:15.758152 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 19 21:40:15.758152 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 19 21:40:15.758152 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:40:15.758152 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi On instance['volume']: May 19 21:40:15.758152 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi '' May 19 21:40:15.758152 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:40:15.758152 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 21:40:15.758152 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:40:15.758152 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:40:15.758152 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 21:40:15.758152 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 21:40:15.758152 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 21:40:15.758152 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 21:40:15.761543 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 21:40:15.761543 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 21:40:15.761543 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 21:40:15.761543 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 21:40:15.761543 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 19 21:40:15.761543 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 19 21:40:15.761543 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 19 21:40:15.761543 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 19 21:40:15.761543 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 19 21:40:15.761543 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 19 21:40:15.761543 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 19 21:40:15.761543 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:40:15.761543 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 21:40:15.761543 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:40:15.761543 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:40:15.761543 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 21:40:15.761543 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 21:40:15.761543 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 19 21:40:15.761543 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 19 21:40:15.763790 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 19 21:40:15.763790 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:40:15.763790 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-b48d0239-92e8-4e2d-94d7-c939bd3d3979 tempest-VolumesNegativeTest-260587248 tempest-VolumesNegativeTest-260587248-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=124349) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 21:40:15.763790 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-b48d0239-92e8-4e2d-94d7-c939bd3d3979 tempest-VolumesNegativeTest-260587248 tempest-VolumesNegativeTest-260587248-project] 10.222.0.65 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.010005 May 19 21:40:15.763790 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 374/760] 10.222.0.65 () {60 vars in 1155 bytes} [Thu May 19 21:40:15 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 19 21:40:15.767796 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-c6915e15-435f-447e-95ad-505faba4be22 tempest-VolumesNegativeTest-260587248 tempest-VolumesNegativeTest-260587248-project] Calling method '.version_select at 0x7fe3635d6c10>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:40:15.799318 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.wsgi [None req-c6915e15-435f-447e-95ad-505faba4be22 tempest-VolumesNegativeTest-260587248 tempest-VolumesNegativeTest-260587248-project] HTTP exception thrown: Volume tempest-invalid-718313440 could not be found. May 19 21:40:15.801331 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-c6915e15-435f-447e-95ad-505faba4be22 tempest-VolumesNegativeTest-260587248 tempest-VolumesNegativeTest-260587248-project] Request method failure captured: May 19 21:40:15.801331 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-718313440 HTTP/1.1 May 19 21:40:15.801331 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Accept: application/json May 19 21:40:15.801331 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Accept-Encoding: identity May 19 21:40:15.801331 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Connection: close May 19 21:40:15.801331 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Content-Length: 0 May 19 21:40:15.801331 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Content-Type: application/json May 19 21:40:15.801331 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Host: 10.222.0.65 May 19 21:40:15.801331 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Openstack-System-Scope: None May 19 21:40:15.801331 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: User-Agent: python-urllib3/1.26.9 May 19 21:40:15.801331 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Auth-Token: gAAAAABihrk_spkeglVSGi7hxg3q1ztkvmK2h0syn0yIMjuOXjGINLST24iZhZyYbdlyK7GFVYtJh8ldVXfuVVZ2hO46QMNhTsmMUhYu1ZyW3avsnln5WvO077zuI9PNUtabzoHseb_9AAnpEqI6InJIBonOipqDtRu0Ry-3CQ-utugqRZQmbz0 May 19 21:40:15.801331 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Domain-Id: None May 19 21:40:15.801331 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Domain-Name: None May 19 21:40:15.801331 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Identity-Status: Confirmed May 19 21:40:15.801331 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Is-Admin-Project: True May 19 21:40:15.801331 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Project-Domain-Id: default May 19 21:40:15.801331 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Project-Domain-Name: Default May 19 21:40:15.801331 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Project-Id: c15dc44be00b47b2851f9778d0babe3e May 19 21:40:15.801331 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Project-Name: tempest-VolumesNegativeTest-260587248 May 19 21:40:15.801331 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Role: reader,member May 19 21:40:15.801331 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Roles: reader,member May 19 21:40:15.802763 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/c15dc44be00b47b2851f9778d0babe3e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/c15dc44be00b47b2851f9778d0babe3e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_c15dc44be00b47b2851f9778d0babe3e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/c15dc44be00b47b2851f9778d0babe3e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}] May 19 21:40:15.802763 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Tenant: tempest-VolumesNegativeTest-260587248 May 19 21:40:15.802763 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Tenant-Id: c15dc44be00b47b2851f9778d0babe3e May 19 21:40:15.802763 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Tenant-Name: tempest-VolumesNegativeTest-260587248 May 19 21:40:15.802763 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-User: tempest-VolumesNegativeTest-260587248-project May 19 21:40:15.802763 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-User-Domain-Id: default May 19 21:40:15.802763 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-User-Domain-Name: Default May 19 21:40:15.802763 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-User-Id: 03ccb0fbb7ce42c0a71bbd7e604bb743 May 19 21:40:15.802763 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-User-Name: tempest-VolumesNegativeTest-260587248-project May 19 21:40:15.802763 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: method: May 19 21:40:15.802763 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: exception: Volume tempest-invalid-718313440 could not be found. May 19 21:40:15.802763 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: action_args: {'id': 'tempest-invalid-718313440'} May 19 21:40:15.802763 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 21:40:15.803659 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:40:15.803659 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 19 21:40:15.803659 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 19 21:40:15.803659 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 19 21:40:15.803659 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 19 21:40:15.803659 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 19 21:40:15.803659 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 19 21:40:15.803659 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 19 21:40:15.803659 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 19 21:40:15.803659 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 19 21:40:15.803659 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 19 21:40:15.803659 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 21:40:15.803659 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 21:40:15.803659 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 21:40:15.803659 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 21:40:15.803659 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-718313440 could not be found. (HTTP 404) (Request-ID: req-fde5e2d7-3831-4a7d-8da2-1764d568c0b2) May 19 21:40:15.803659 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi May 19 21:40:15.803659 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 21:40:15.803659 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi May 19 21:40:15.805773 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:40:15.805773 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 19 21:40:15.805773 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 19 21:40:15.805773 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 19 21:40:15.805773 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 19 21:40:15.805773 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 19 21:40:15.805773 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 19 21:40:15.805773 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 19 21:40:15.805773 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 19 21:40:15.805773 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 19 21:40:15.805773 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 19 21:40:15.805773 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 19 21:40:15.805773 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 19 21:40:15.805773 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 19 21:40:15.805773 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 19 21:40:15.805773 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 19 21:40:15.805773 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 19 21:40:15.805773 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 19 21:40:15.805773 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 19 21:40:15.807549 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 21:40:15.807549 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 21:40:15.807549 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 21:40:15.807549 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 21:40:15.807549 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-718313440 could not be found. May 19 21:40:15.807549 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi May 19 21:40:15.807549 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 21:40:15.807549 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi May 19 21:40:15.807549 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:40:15.807549 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 21:40:15.807549 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 21:40:15.807549 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 21:40:15.807549 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 21:40:15.807549 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 21:40:15.807549 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 21:40:15.807549 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 21:40:15.807549 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 21:40:15.807549 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 19 21:40:15.807549 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 21:40:15.807549 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-718313440 could not be found. May 19 21:40:15.809454 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi May 19 21:40:15.809454 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 21:40:15.809454 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi May 19 21:40:15.809454 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:40:15.809454 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 21:40:15.809454 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 21:40:15.809454 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 21:40:15.809454 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 21:40:15.809454 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-718313440 could not be found. May 19 21:40:15.809454 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi May 19 21:40:15.809454 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-c6915e15-435f-447e-95ad-505faba4be22 tempest-VolumesNegativeTest-260587248 tempest-VolumesNegativeTest-260587248-project] Returning 404 to user: Volume tempest-invalid-718313440 could not be found. {{(pid=124350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 21:40:15.809454 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-c6915e15-435f-447e-95ad-505faba4be22 tempest-VolumesNegativeTest-260587248 tempest-VolumesNegativeTest-260587248-project] 10.222.0.65 "DELETE /compute/v2.1/os-volumes/tempest-invalid-718313440" status: 404 len: 98 microversion: 2.1 time: 0.040794 May 19 21:40:15.809454 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 387/761] 10.222.0.65 () {58 vars in 1214 bytes} [Thu May 19 21:40:15 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-718313440 => generated 98 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 19 21:40:15.813925 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-27d30940-9528-411a-9d19-a063f6a8e4ed tempest-VolumesNegativeTest-260587248 tempest-VolumesNegativeTest-260587248-project] 10.222.0.65 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005222 May 19 21:40:15.814470 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 375/762] 10.222.0.65 () {58 vars in 1139 bytes} [Thu May 19 21:40:15 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 19 21:40:15.823642 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-22eb2b0d-36e3-41a3-a491-5a5715065aa7 tempest-VolumesNegativeTest-260587248 tempest-VolumesNegativeTest-260587248-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003836 May 19 21:40:15.824168 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 388/763] 10.222.0.65 () {58 vars in 1136 bytes} [Thu May 19 21:40:15 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 19 21:40:15.833756 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-88dfcee5-8b0a-49b1-a60f-31eff36509e4 tempest-VolumesNegativeTest-260587248 tempest-VolumesNegativeTest-260587248-project] Calling method '.version_select at 0x7fe3634d1790>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:40:15.866561 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.wsgi [None req-88dfcee5-8b0a-49b1-a60f-31eff36509e4 tempest-VolumesNegativeTest-260587248 tempest-VolumesNegativeTest-260587248-project] HTTP exception thrown: Volume 14aea3c0-a4b6-4cee-833e-7e6c53a1e9b8 could not be found. May 19 21:40:15.868615 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-88dfcee5-8b0a-49b1-a60f-31eff36509e4 tempest-VolumesNegativeTest-260587248 tempest-VolumesNegativeTest-260587248-project] Request method failure captured: May 19 21:40:15.868615 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: request: DELETE /compute/v2.1/os-volumes/14aea3c0-a4b6-4cee-833e-7e6c53a1e9b8 HTTP/1.1 May 19 21:40:15.868615 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Accept: application/json May 19 21:40:15.868615 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Accept-Encoding: identity May 19 21:40:15.868615 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Connection: close May 19 21:40:15.868615 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Content-Length: 0 May 19 21:40:15.868615 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Content-Type: application/json May 19 21:40:15.868615 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Host: 10.222.0.65 May 19 21:40:15.868615 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Openstack-System-Scope: None May 19 21:40:15.868615 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: User-Agent: python-urllib3/1.26.9 May 19 21:40:15.868615 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Auth-Token: gAAAAABihrk_spkeglVSGi7hxg3q1ztkvmK2h0syn0yIMjuOXjGINLST24iZhZyYbdlyK7GFVYtJh8ldVXfuVVZ2hO46QMNhTsmMUhYu1ZyW3avsnln5WvO077zuI9PNUtabzoHseb_9AAnpEqI6InJIBonOipqDtRu0Ry-3CQ-utugqRZQmbz0 May 19 21:40:15.868615 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Domain-Id: None May 19 21:40:15.868615 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Domain-Name: None May 19 21:40:15.868615 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Identity-Status: Confirmed May 19 21:40:15.868615 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Is-Admin-Project: True May 19 21:40:15.868615 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Project-Domain-Id: default May 19 21:40:15.868615 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Project-Domain-Name: Default May 19 21:40:15.868615 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Project-Id: c15dc44be00b47b2851f9778d0babe3e May 19 21:40:15.868615 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Project-Name: tempest-VolumesNegativeTest-260587248 May 19 21:40:15.868615 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Role: reader,member May 19 21:40:15.868615 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Roles: reader,member May 19 21:40:15.870175 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/c15dc44be00b47b2851f9778d0babe3e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/c15dc44be00b47b2851f9778d0babe3e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_c15dc44be00b47b2851f9778d0babe3e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/c15dc44be00b47b2851f9778d0babe3e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}] May 19 21:40:15.870175 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Tenant: tempest-VolumesNegativeTest-260587248 May 19 21:40:15.870175 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Tenant-Id: c15dc44be00b47b2851f9778d0babe3e May 19 21:40:15.870175 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Tenant-Name: tempest-VolumesNegativeTest-260587248 May 19 21:40:15.870175 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-User: tempest-VolumesNegativeTest-260587248-project May 19 21:40:15.870175 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-User-Domain-Id: default May 19 21:40:15.870175 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-User-Domain-Name: Default May 19 21:40:15.870175 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-User-Id: 03ccb0fbb7ce42c0a71bbd7e604bb743 May 19 21:40:15.870175 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-User-Name: tempest-VolumesNegativeTest-260587248-project May 19 21:40:15.870175 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: method: May 19 21:40:15.870175 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: exception: Volume 14aea3c0-a4b6-4cee-833e-7e6c53a1e9b8 could not be found. May 19 21:40:15.870175 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: action_args: {'id': '14aea3c0-a4b6-4cee-833e-7e6c53a1e9b8'} May 19 21:40:15.870175 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 21:40:15.871143 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:40:15.871143 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 19 21:40:15.871143 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 19 21:40:15.871143 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 19 21:40:15.871143 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 19 21:40:15.871143 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 19 21:40:15.871143 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 19 21:40:15.871143 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 19 21:40:15.871143 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 19 21:40:15.871143 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 19 21:40:15.871143 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 19 21:40:15.871143 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 21:40:15.871143 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 21:40:15.871143 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 21:40:15.871143 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 21:40:15.871143 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 14aea3c0-a4b6-4cee-833e-7e6c53a1e9b8 could not be found. (HTTP 404) (Request-ID: req-32dc4d80-cedb-423c-b7d1-ca37b9b6331a) May 19 21:40:15.871143 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:40:15.871143 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 21:40:15.871143 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:40:15.872469 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:40:15.872469 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 19 21:40:15.872469 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 19 21:40:15.872469 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 19 21:40:15.872469 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 19 21:40:15.872469 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 19 21:40:15.872469 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 19 21:40:15.872469 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 19 21:40:15.872469 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 19 21:40:15.872469 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 19 21:40:15.872469 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 19 21:40:15.872469 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 19 21:40:15.872469 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 19 21:40:15.872469 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 19 21:40:15.872469 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 19 21:40:15.872469 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 19 21:40:15.872469 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 19 21:40:15.872469 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 19 21:40:15.872469 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 19 21:40:15.873880 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 21:40:15.873880 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 21:40:15.873880 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 21:40:15.873880 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 21:40:15.873880 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 14aea3c0-a4b6-4cee-833e-7e6c53a1e9b8 could not be found. May 19 21:40:15.873880 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:40:15.873880 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 21:40:15.873880 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:40:15.873880 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:40:15.873880 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 21:40:15.873880 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 21:40:15.873880 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 21:40:15.873880 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 21:40:15.873880 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 21:40:15.873880 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 21:40:15.873880 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 21:40:15.873880 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 21:40:15.873880 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 19 21:40:15.873880 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 21:40:15.875217 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 14aea3c0-a4b6-4cee-833e-7e6c53a1e9b8 could not be found. May 19 21:40:15.875217 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:40:15.875217 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 21:40:15.875217 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:40:15.875217 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:40:15.875217 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 21:40:15.875217 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 21:40:15.875217 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 21:40:15.875217 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 21:40:15.875217 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 14aea3c0-a4b6-4cee-833e-7e6c53a1e9b8 could not be found. May 19 21:40:15.875217 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:40:15.875217 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-88dfcee5-8b0a-49b1-a60f-31eff36509e4 tempest-VolumesNegativeTest-260587248 tempest-VolumesNegativeTest-260587248-project] Returning 404 to user: Volume 14aea3c0-a4b6-4cee-833e-7e6c53a1e9b8 could not be found. {{(pid=124349) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 21:40:15.875217 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-88dfcee5-8b0a-49b1-a60f-31eff36509e4 tempest-VolumesNegativeTest-260587248 tempest-VolumesNegativeTest-260587248-project] 10.222.0.65 "DELETE /compute/v2.1/os-volumes/14aea3c0-a4b6-4cee-833e-7e6c53a1e9b8" status: 404 len: 109 microversion: 2.1 time: 0.040205 May 19 21:40:15.875217 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 376/764] 10.222.0.65 () {58 vars in 1247 bytes} [Thu May 19 21:40:15 2022] DELETE /compute/v2.1/os-volumes/14aea3c0-a4b6-4cee-833e-7e6c53a1e9b8 => generated 109 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 21:40:15.881239 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-b3c202db-c198-4441-b095-46c8b922075b tempest-VolumesNegativeTest-260587248 tempest-VolumesNegativeTest-260587248-project] Calling method '.version_select at 0x7fe3636ca700>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:40:15.914932 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.wsgi [None req-b3c202db-c198-4441-b095-46c8b922075b tempest-VolumesNegativeTest-260587248 tempest-VolumesNegativeTest-260587248-project] HTTP exception thrown: Volume 4ecc3d2a-b6c9-4e9f-ab23-bd6c40fafd3e could not be found. May 19 21:40:15.916959 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-b3c202db-c198-4441-b095-46c8b922075b tempest-VolumesNegativeTest-260587248 tempest-VolumesNegativeTest-260587248-project] Request method failure captured: May 19 21:40:15.916959 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: request: GET /compute/v2.1/os-volumes/4ecc3d2a-b6c9-4e9f-ab23-bd6c40fafd3e HTTP/1.1 May 19 21:40:15.916959 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Accept: application/json May 19 21:40:15.916959 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Accept-Encoding: identity May 19 21:40:15.916959 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Connection: close May 19 21:40:15.916959 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Content-Length: 0 May 19 21:40:15.916959 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Content-Type: application/json May 19 21:40:15.916959 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Host: 10.222.0.65 May 19 21:40:15.916959 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Openstack-System-Scope: None May 19 21:40:15.916959 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: User-Agent: python-urllib3/1.26.9 May 19 21:40:15.916959 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Auth-Token: gAAAAABihrk_spkeglVSGi7hxg3q1ztkvmK2h0syn0yIMjuOXjGINLST24iZhZyYbdlyK7GFVYtJh8ldVXfuVVZ2hO46QMNhTsmMUhYu1ZyW3avsnln5WvO077zuI9PNUtabzoHseb_9AAnpEqI6InJIBonOipqDtRu0Ry-3CQ-utugqRZQmbz0 May 19 21:40:15.916959 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Domain-Id: None May 19 21:40:15.916959 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Domain-Name: None May 19 21:40:15.916959 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Identity-Status: Confirmed May 19 21:40:15.916959 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Is-Admin-Project: True May 19 21:40:15.916959 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Project-Domain-Id: default May 19 21:40:15.916959 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Project-Domain-Name: Default May 19 21:40:15.916959 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Project-Id: c15dc44be00b47b2851f9778d0babe3e May 19 21:40:15.916959 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Project-Name: tempest-VolumesNegativeTest-260587248 May 19 21:40:15.916959 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Role: reader,member May 19 21:40:15.916959 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Roles: reader,member May 19 21:40:15.919609 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/c15dc44be00b47b2851f9778d0babe3e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/c15dc44be00b47b2851f9778d0babe3e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_c15dc44be00b47b2851f9778d0babe3e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/c15dc44be00b47b2851f9778d0babe3e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}] May 19 21:40:15.919609 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Tenant: tempest-VolumesNegativeTest-260587248 May 19 21:40:15.919609 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Tenant-Id: c15dc44be00b47b2851f9778d0babe3e May 19 21:40:15.919609 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Tenant-Name: tempest-VolumesNegativeTest-260587248 May 19 21:40:15.919609 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-User: tempest-VolumesNegativeTest-260587248-project May 19 21:40:15.919609 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-User-Domain-Id: default May 19 21:40:15.919609 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-User-Domain-Name: Default May 19 21:40:15.919609 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-User-Id: 03ccb0fbb7ce42c0a71bbd7e604bb743 May 19 21:40:15.919609 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-User-Name: tempest-VolumesNegativeTest-260587248-project May 19 21:40:15.919609 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: method: May 19 21:40:15.919609 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: exception: Volume 4ecc3d2a-b6c9-4e9f-ab23-bd6c40fafd3e could not be found. May 19 21:40:15.919609 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: action_args: {'id': '4ecc3d2a-b6c9-4e9f-ab23-bd6c40fafd3e'} May 19 21:40:15.919609 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 21:40:15.922229 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:40:15.922229 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 19 21:40:15.922229 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 19 21:40:15.922229 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 19 21:40:15.922229 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi item = cinderclient( May 19 21:40:15.922229 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 19 21:40:15.922229 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 19 21:40:15.922229 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 19 21:40:15.922229 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 19 21:40:15.922229 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 19 21:40:15.922229 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 19 21:40:15.922229 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 21:40:15.922229 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 21:40:15.922229 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 21:40:15.922229 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 21:40:15.922229 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4ecc3d2a-b6c9-4e9f-ab23-bd6c40fafd3e could not be found. (HTTP 404) (Request-ID: req-7b2a363b-5791-4edb-a904-0375753e3191) May 19 21:40:15.922229 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi May 19 21:40:15.922229 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 21:40:15.922229 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi May 19 21:40:15.924668 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:40:15.924668 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 19 21:40:15.924668 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 19 21:40:15.924668 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 19 21:40:15.924668 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 19 21:40:15.924668 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 19 21:40:15.924668 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 19 21:40:15.924668 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 19 21:40:15.924668 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 19 21:40:15.924668 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 19 21:40:15.924668 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 19 21:40:15.924668 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 19 21:40:15.924668 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi item = cinderclient( May 19 21:40:15.924668 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 19 21:40:15.924668 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 19 21:40:15.924668 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 19 21:40:15.924668 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 19 21:40:15.924668 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 19 21:40:15.924668 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 19 21:40:15.927028 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 21:40:15.927028 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 21:40:15.927028 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 21:40:15.927028 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 21:40:15.927028 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4ecc3d2a-b6c9-4e9f-ab23-bd6c40fafd3e could not be found. May 19 21:40:15.927028 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi May 19 21:40:15.927028 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 21:40:15.927028 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi May 19 21:40:15.927028 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:40:15.927028 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 21:40:15.927028 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 21:40:15.927028 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 21:40:15.927028 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 21:40:15.927028 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 21:40:15.927028 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 21:40:15.927028 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 21:40:15.927028 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 21:40:15.927028 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 19 21:40:15.927028 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 21:40:15.929348 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4ecc3d2a-b6c9-4e9f-ab23-bd6c40fafd3e could not be found. May 19 21:40:15.929348 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi May 19 21:40:15.929348 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 21:40:15.929348 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi May 19 21:40:15.929348 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:40:15.929348 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 21:40:15.929348 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 21:40:15.929348 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 21:40:15.929348 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 21:40:15.929348 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4ecc3d2a-b6c9-4e9f-ab23-bd6c40fafd3e could not be found. May 19 21:40:15.929348 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi May 19 21:40:15.929348 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-b3c202db-c198-4441-b095-46c8b922075b tempest-VolumesNegativeTest-260587248 tempest-VolumesNegativeTest-260587248-project] Returning 404 to user: Volume 4ecc3d2a-b6c9-4e9f-ab23-bd6c40fafd3e could not be found. {{(pid=124350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 21:40:15.929348 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-b3c202db-c198-4441-b095-46c8b922075b tempest-VolumesNegativeTest-260587248 tempest-VolumesNegativeTest-260587248-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/4ecc3d2a-b6c9-4e9f-ab23-bd6c40fafd3e" status: 404 len: 109 microversion: 2.1 time: 0.041182 May 19 21:40:15.929348 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 389/765] 10.222.0.65 () {58 vars in 1244 bytes} [Thu May 19 21:40:15 2022] GET /compute/v2.1/os-volumes/4ecc3d2a-b6c9-4e9f-ab23-bd6c40fafd3e => generated 109 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 21:40:27.540859 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:40:27.542066 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_cell1:SELECT=29,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:40:27.761514 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-a13106b1-0153-4691-b420-d24907227777 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-569033552"}} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:40:27.762182 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-a13106b1-0153-4691-b420-d24907227777 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] [instance: 89cb2230-d75e-4c8c-b47b-83f1698654dd] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:40:27.770869 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a13106b1-0153-4691-b420-d24907227777 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:40:27.771608 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a13106b1-0153-4691-b420-d24907227777 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:40:27.772686 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a13106b1-0153-4691-b420-d24907227777 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:40:27.773152 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a13106b1-0153-4691-b420-d24907227777 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:40:27.935002 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.network.security_group_api [None req-a13106b1-0153-4691-b420-d24907227777 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Removing security group 082c9cd4-963c-4820-b7ef-bef409d33ad2 from port c48b591a-ce03-49e5-b5c1-3715c76df0d6 May 19 21:40:28.443910 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-a13106b1-0153-4691-b420-d24907227777 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] 10.222.0.65 "POST /compute/v2.1/servers/89cb2230-d75e-4c8c-b47b-83f1698654dd/action" status: 202 len: 0 microversion: 2.1 time: 0.904239 May 19 21:40:28.445211 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 377/766] 10.222.0.65 () {60 vars in 1277 bytes} [Thu May 19 21:40:27 2022] POST /compute/v2.1/servers/89cb2230-d75e-4c8c-b47b-83f1698654dd/action => generated 0 bytes in 907 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 21:40:28.458884 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_api:SELECT=21,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:40:28.460929 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell1:SELECT=29,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:40:28.471222 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [req-d3591f77-39e5-4223-8f77-ed43e93bc702 req-c0f8b305-4739-4a70-b46a-68f68909b09a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89cb2230-d75e-4c8c-b47b-83f1698654dd", "tag": "c48b591a-ce03-49e5-b5c1-3715c76df0d6"}]} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:40:28.496018 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-d3591f77-39e5-4223-8f77-ed43e93bc702 req-c0f8b305-4739-4a70-b46a-68f68909b09a service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:40:28.496822 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-d3591f77-39e5-4223-8f77-ed43e93bc702 req-c0f8b305-4739-4a70-b46a-68f68909b09a service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:40:28.515696 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.compute.server_external_events [req-d3591f77-39e5-4223-8f77-ed43e93bc702 req-c0f8b305-4739-4a70-b46a-68f68909b09a service nova] Creating event network-changed:c48b591a-ce03-49e5-b5c1-3715c76df0d6 for instance 89cb2230-d75e-4c8c-b47b-83f1698654dd on hv-cinder-83563 May 19 21:40:28.527774 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [req-d3591f77-39e5-4223-8f77-ed43e93bc702 req-c0f8b305-4739-4a70-b46a-68f68909b09a service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071745 May 19 21:40:28.528986 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 390/767] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 21:40:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 21:40:29.995642 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-bb1ec1e6-e76b-4bb5-ab5f-8d46249b5580 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:40:29.996231 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-bb1ec1e6-e76b-4bb5-ab5f-8d46249b5580 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] [instance: 89cb2230-d75e-4c8c-b47b-83f1698654dd] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:40:30.002881 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-bb1ec1e6-e76b-4bb5-ab5f-8d46249b5580 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:40:30.003333 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-bb1ec1e6-e76b-4bb5-ab5f-8d46249b5580 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:40:30.004108 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-bb1ec1e6-e76b-4bb5-ab5f-8d46249b5580 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:40:30.004546 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-bb1ec1e6-e76b-4bb5-ab5f-8d46249b5580 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:40:30.100605 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.objects.instance [None req-bb1ec1e6-e76b-4bb5-ab5f-8d46249b5580 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lazy-loading 'services' on Instance uuid 89cb2230-d75e-4c8c-b47b-83f1698654dd {{(pid=124349) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 21:40:30.196336 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-bb1ec1e6-e76b-4bb5-ab5f-8d46249b5580 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] 10.222.0.65 "DELETE /compute/v2.1/servers/89cb2230-d75e-4c8c-b47b-83f1698654dd/os-volume_attachments/c220f89b-8a33-4a71-8af4-b42af759f9d3" status: 202 len: 0 microversion: 2.1 time: 0.205080 May 19 21:40:30.197077 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 378/768] 10.222.0.65 () {58 vars in 1415 bytes} [Thu May 19 21:40:29 2022] DELETE /compute/v2.1/servers/89cb2230-d75e-4c8c-b47b-83f1698654dd/os-volume_attachments/c220f89b-8a33-4a71-8af4-b42af759f9d3 => generated 0 bytes in 207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 21:40:30.207152 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-1f97b8ee-fcf8-4e30-be47-768f6c86a645 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:40:30.209316 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-1f97b8ee-fcf8-4e30-be47-768f6c86a645 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] [instance: 89cb2230-d75e-4c8c-b47b-83f1698654dd] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:40:30.217173 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1f97b8ee-fcf8-4e30-be47-768f6c86a645 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:40:30.217764 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1f97b8ee-fcf8-4e30-be47-768f6c86a645 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:40:30.218903 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1f97b8ee-fcf8-4e30-be47-768f6c86a645 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:40:30.219539 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1f97b8ee-fcf8-4e30-be47-768f6c86a645 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:40:30.283222 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-1f97b8ee-fcf8-4e30-be47-768f6c86a645 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] 10.222.0.65 "GET /compute/v2.1/servers/89cb2230-d75e-4c8c-b47b-83f1698654dd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079884 May 19 21:40:30.284712 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 391/769] 10.222.0.65 () {58 vars in 1301 bytes} [Thu May 19 21:40:30 2022] GET /compute/v2.1/servers/89cb2230-d75e-4c8c-b47b-83f1698654dd/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 21:40:30.537101 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-f088d489-efbc-475f-afbf-de76fa4ed146 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:40:30.539304 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-f088d489-efbc-475f-afbf-de76fa4ed146 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] [instance: a392a14d-152c-467f-8031-a4bb8e36e5bb] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:40:30.558021 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f088d489-efbc-475f-afbf-de76fa4ed146 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:40:30.558651 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f088d489-efbc-475f-afbf-de76fa4ed146 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:40:30.559603 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f088d489-efbc-475f-afbf-de76fa4ed146 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:40:30.560139 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f088d489-efbc-475f-afbf-de76fa4ed146 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:40:30.563852 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [req-22597286-4b1d-42c2-9ede-42c4fa38368b req-2e5da254-5754-499c-b17a-4de96f3fdab2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89cb2230-d75e-4c8c-b47b-83f1698654dd", "tag": "c48b591a-ce03-49e5-b5c1-3715c76df0d6"}]} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:40:30.580425 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-22597286-4b1d-42c2-9ede-42c4fa38368b req-2e5da254-5754-499c-b17a-4de96f3fdab2 service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:40:30.581239 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-22597286-4b1d-42c2-9ede-42c4fa38368b req-2e5da254-5754-499c-b17a-4de96f3fdab2 service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:40:30.595147 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-f088d489-efbc-475f-afbf-de76fa4ed146 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] 10.222.0.65 "GET /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.067277 May 19 21:40:30.596357 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 379/770] 10.222.0.65 () {58 vars in 1301 bytes} [Thu May 19 21:40:30 2022] GET /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb/os-volume_attachments => generated 25 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 21:40:30.613012 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.compute.server_external_events [req-22597286-4b1d-42c2-9ede-42c4fa38368b req-2e5da254-5754-499c-b17a-4de96f3fdab2 service nova] Creating event network-changed:c48b591a-ce03-49e5-b5c1-3715c76df0d6 for instance 89cb2230-d75e-4c8c-b47b-83f1698654dd on hv-cinder-83563 May 19 21:40:30.619979 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [req-22597286-4b1d-42c2-9ede-42c4fa38368b req-2e5da254-5754-499c-b17a-4de96f3fdab2 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063956 May 19 21:40:30.621019 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 392/771] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 21:40:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 21:40:30.697499 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-82f4f7cb-77e0-4cb4-a22d-87dbde0ccf5e tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:40:30.698284 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-82f4f7cb-77e0-4cb4-a22d-87dbde0ccf5e tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] [instance: a392a14d-152c-467f-8031-a4bb8e36e5bb] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:40:30.708218 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-82f4f7cb-77e0-4cb4-a22d-87dbde0ccf5e tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:40:30.708938 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-82f4f7cb-77e0-4cb4-a22d-87dbde0ccf5e tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:40:30.709923 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-82f4f7cb-77e0-4cb4-a22d-87dbde0ccf5e tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:40:30.710579 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-82f4f7cb-77e0-4cb4-a22d-87dbde0ccf5e tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:40:30.739324 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-82f4f7cb-77e0-4cb4-a22d-87dbde0ccf5e tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] [instance: a392a14d-152c-467f-8031-a4bb8e36e5bb] Going to try to terminate instance {{(pid=124349) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 21:40:30.864650 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-82f4f7cb-77e0-4cb4-a22d-87dbde0ccf5e tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] 10.222.0.65 "DELETE /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb" status: 204 len: 0 microversion: 2.1 time: 0.176526 May 19 21:40:30.868427 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 380/772] 10.222.0.65 () {58 vars in 1238 bytes} [Thu May 19 21:40:30 2022] DELETE /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb => generated 0 bytes in 179 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 21:40:30.879013 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-8ff25d4e-49ca-422d-9198-a6f9e44ad80f tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:40:30.880276 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-8ff25d4e-49ca-422d-9198-a6f9e44ad80f tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] [instance: a392a14d-152c-467f-8031-a4bb8e36e5bb] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:40:30.898623 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8ff25d4e-49ca-422d-9198-a6f9e44ad80f tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:40:30.899398 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8ff25d4e-49ca-422d-9198-a6f9e44ad80f tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:40:30.901500 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8ff25d4e-49ca-422d-9198-a6f9e44ad80f tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:40:30.902665 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8ff25d4e-49ca-422d-9198-a6f9e44ad80f tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:40:31.090598 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-8ff25d4e-49ca-422d-9198-a6f9e44ad80f tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d16feb169ac46f7983a6b8045de77c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f5916770e9b443489fe7aa76d663fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:40:31.104082 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-8ff25d4e-49ca-422d-9198-a6f9e44ad80f tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] 10.222.0.65 "GET /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb" status: 200 len: 1673 microversion: 2.1 time: 0.233473 May 19 21:40:31.104971 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 393/773] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:40:30 2022] GET /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb => generated 1673 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:40:31.297015 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-c31e5848-5cfe-4847-96e1-ecb36f81a683 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:40:31.299903 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-c31e5848-5cfe-4847-96e1-ecb36f81a683 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] [instance: 89cb2230-d75e-4c8c-b47b-83f1698654dd] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:40:31.309223 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c31e5848-5cfe-4847-96e1-ecb36f81a683 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:40:31.310164 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c31e5848-5cfe-4847-96e1-ecb36f81a683 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:40:31.311331 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c31e5848-5cfe-4847-96e1-ecb36f81a683 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:40:31.311938 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c31e5848-5cfe-4847-96e1-ecb36f81a683 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:40:31.360040 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-c31e5848-5cfe-4847-96e1-ecb36f81a683 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] 10.222.0.65 "GET /compute/v2.1/servers/89cb2230-d75e-4c8c-b47b-83f1698654dd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067888 May 19 21:40:31.363949 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 381/774] 10.222.0.65 () {58 vars in 1301 bytes} [Thu May 19 21:40:31 2022] GET /compute/v2.1/servers/89cb2230-d75e-4c8c-b47b-83f1698654dd/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 21:40:32.122916 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-be554a29-37a8-4152-9777-59ed34bae174 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:40:32.123840 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-be554a29-37a8-4152-9777-59ed34bae174 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] [instance: a392a14d-152c-467f-8031-a4bb8e36e5bb] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:40:32.137518 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-be554a29-37a8-4152-9777-59ed34bae174 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:40:32.138087 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-be554a29-37a8-4152-9777-59ed34bae174 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:40:32.139390 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-be554a29-37a8-4152-9777-59ed34bae174 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:40:32.139910 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-be554a29-37a8-4152-9777-59ed34bae174 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:40:32.371390 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-6e6f8b23-917a-4241-afec-5f76b87d6862 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:40:32.373520 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-6e6f8b23-917a-4241-afec-5f76b87d6862 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] [instance: 89cb2230-d75e-4c8c-b47b-83f1698654dd] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:40:32.391898 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-6e6f8b23-917a-4241-afec-5f76b87d6862 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:40:32.392461 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-6e6f8b23-917a-4241-afec-5f76b87d6862 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:40:32.393667 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-be554a29-37a8-4152-9777-59ed34bae174 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d16feb169ac46f7983a6b8045de77c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f5916770e9b443489fe7aa76d663fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:40:32.394395 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-6e6f8b23-917a-4241-afec-5f76b87d6862 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:40:32.394925 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-6e6f8b23-917a-4241-afec-5f76b87d6862 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:40:32.402625 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-be554a29-37a8-4152-9777-59ed34bae174 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] 10.222.0.65 "GET /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb" status: 200 len: 1673 microversion: 2.1 time: 0.284365 May 19 21:40:32.412278 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 394/775] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:40:32 2022] GET /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb => generated 1673 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:40:32.437612 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-6e6f8b23-917a-4241-afec-5f76b87d6862 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] 10.222.0.65 "GET /compute/v2.1/servers/89cb2230-d75e-4c8c-b47b-83f1698654dd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.070204 May 19 21:40:32.438914 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 382/776] 10.222.0.65 () {58 vars in 1301 bytes} [Thu May 19 21:40:32 2022] GET /compute/v2.1/servers/89cb2230-d75e-4c8c-b47b-83f1698654dd/os-volume_attachments => generated 25 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 19 21:40:32.450393 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-534292d1-bc93-4a8c-a986-38ef878ed813 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:40:32.451158 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-534292d1-bc93-4a8c-a986-38ef878ed813 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] [instance: 89cb2230-d75e-4c8c-b47b-83f1698654dd] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:40:32.460487 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-534292d1-bc93-4a8c-a986-38ef878ed813 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:40:32.465534 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-534292d1-bc93-4a8c-a986-38ef878ed813 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:40:32.466561 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-534292d1-bc93-4a8c-a986-38ef878ed813 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:40:32.467455 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-534292d1-bc93-4a8c-a986-38ef878ed813 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:40:32.551637 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.wsgi [None req-534292d1-bc93-4a8c-a986-38ef878ed813 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] HTTP exception thrown: Instance 89cb2230-d75e-4c8c-b47b-83f1698654dd is not attached to volume c220f89b-8a33-4a71-8af4-b42af759f9d3 May 19 21:40:32.581074 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-534292d1-bc93-4a8c-a986-38ef878ed813 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Request method failure captured: May 19 21:40:32.581074 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: request: DELETE /compute/v2.1/servers/89cb2230-d75e-4c8c-b47b-83f1698654dd/os-volume_attachments/c220f89b-8a33-4a71-8af4-b42af759f9d3 HTTP/1.1 May 19 21:40:32.581074 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Accept: application/json May 19 21:40:32.581074 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Accept-Encoding: identity May 19 21:40:32.581074 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Connection: close May 19 21:40:32.581074 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Content-Length: 0 May 19 21:40:32.581074 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Content-Type: application/json May 19 21:40:32.581074 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Host: 10.222.0.65 May 19 21:40:32.581074 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Openstack-System-Scope: None May 19 21:40:32.581074 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: User-Agent: python-urllib3/1.26.9 May 19 21:40:32.581074 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Auth-Token: gAAAAABihrfu-Pd5zRQoY2TVmCNkLGG9jG6MvWLH8iVfJ3fcF1xnJ9cnvM31NhhHWk1MVZsphJbBk6cTMrVLePjMgy6pcc8suoy-_JNF7SW-iGN6zlma3RE4OW0nBkQbrll12_Wm0W88MQzr2zyMmpJjzFxxTAf-dp1aIZfAiavDrOvadssQB24 May 19 21:40:32.581074 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Domain-Id: None May 19 21:40:32.581074 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Domain-Name: None May 19 21:40:32.581074 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Identity-Status: Confirmed May 19 21:40:32.581074 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Is-Admin-Project: True May 19 21:40:32.581074 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Project-Domain-Id: default May 19 21:40:32.581074 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Project-Domain-Name: Default May 19 21:40:32.581074 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Project-Id: 3fcf03712c6f4926a2a95dfd0519536a May 19 21:40:32.581074 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Project-Name: tempest-TestMinimumBasicScenario-1819376202 May 19 21:40:32.581074 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Role: reader,member May 19 21:40:32.581074 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Roles: reader,member May 19 21:40:32.585496 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/3fcf03712c6f4926a2a95dfd0519536a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/3fcf03712c6f4926a2a95dfd0519536a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_3fcf03712c6f4926a2a95dfd0519536a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/3fcf03712c6f4926a2a95dfd0519536a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}] May 19 21:40:32.585496 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Tenant: tempest-TestMinimumBasicScenario-1819376202 May 19 21:40:32.585496 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Tenant-Id: 3fcf03712c6f4926a2a95dfd0519536a May 19 21:40:32.585496 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1819376202 May 19 21:40:32.585496 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-User: tempest-TestMinimumBasicScenario-1819376202-project May 19 21:40:32.585496 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-User-Domain-Id: default May 19 21:40:32.585496 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-User-Domain-Name: Default May 19 21:40:32.585496 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-User-Id: 1664dba0cd9b4d9da1e4b78691b8567e May 19 21:40:32.585496 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-User-Name: tempest-TestMinimumBasicScenario-1819376202-project May 19 21:40:32.585496 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: method: > May 19 21:40:32.585496 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: exception: Instance 89cb2230-d75e-4c8c-b47b-83f1698654dd is not attached to volume c220f89b-8a33-4a71-8af4-b42af759f9d3 May 19 21:40:32.588391 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: action_args: {'server_id': '89cb2230-d75e-4c8c-b47b-83f1698654dd', 'id': 'c220f89b-8a33-4a71-8af4-b42af759f9d3'} May 19 21:40:32.588391 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 21:40:32.588391 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:40:32.588391 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete May 19 21:40:32.588391 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( May 19 21:40:32.588391 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 19 21:40:32.588391 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 19 21:40:32.588391 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance May 19 21:40:32.588391 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) May 19 21:40:32.588391 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id c220f89b-8a33-4a71-8af4-b42af759f9d3. May 19 21:40:32.588391 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi May 19 21:40:32.588391 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 21:40:32.588391 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi May 19 21:40:32.588391 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:40:32.588391 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 21:40:32.588391 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 21:40:32.588391 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 21:40:32.588391 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 21:40:32.588391 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 21:40:32.595172 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 21:40:32.595172 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete May 19 21:40:32.595172 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 19 21:40:32.595172 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89cb2230-d75e-4c8c-b47b-83f1698654dd is not attached to volume c220f89b-8a33-4a71-8af4-b42af759f9d3 May 19 21:40:32.595172 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi May 19 21:40:32.595172 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 21:40:32.595172 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi May 19 21:40:32.595172 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:40:32.595172 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 21:40:32.595172 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 21:40:32.595172 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 21:40:32.595172 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 21:40:32.595172 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89cb2230-d75e-4c8c-b47b-83f1698654dd is not attached to volume c220f89b-8a33-4a71-8af4-b42af759f9d3 May 19 21:40:32.595172 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi May 19 21:40:32.595172 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-534292d1-bc93-4a8c-a986-38ef878ed813 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Returning 404 to user: Instance 89cb2230-d75e-4c8c-b47b-83f1698654dd is not attached to volume c220f89b-8a33-4a71-8af4-b42af759f9d3 {{(pid=124350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 21:40:32.600498 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-534292d1-bc93-4a8c-a986-38ef878ed813 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] 10.222.0.65 "DELETE /compute/v2.1/servers/89cb2230-d75e-4c8c-b47b-83f1698654dd/os-volume_attachments/c220f89b-8a33-4a71-8af4-b42af759f9d3" status: 404 len: 154 microversion: 2.1 time: 0.137800 May 19 21:40:32.600498 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 395/777] 10.222.0.65 () {58 vars in 1415 bytes} [Thu May 19 21:40:32 2022] DELETE /compute/v2.1/servers/89cb2230-d75e-4c8c-b47b-83f1698654dd/os-volume_attachments/c220f89b-8a33-4a71-8af4-b42af759f9d3 => generated 154 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 21:40:33.291398 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [req-acf51d47-67b6-412e-aaae-79c818072d34 req-d99d54b5-449a-4610-82b9-a8f3e15d0f89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a392a14d-152c-467f-8031-a4bb8e36e5bb", "name": "network-vif-deleted", "tag": "273956f8-6ada-4c24-9d33-e37b581a5bb1"}]} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:40:33.301423 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-acf51d47-67b6-412e-aaae-79c818072d34 req-d99d54b5-449a-4610-82b9-a8f3e15d0f89 service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:40:33.301423 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-acf51d47-67b6-412e-aaae-79c818072d34 req-d99d54b5-449a-4610-82b9-a8f3e15d0f89 service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:40:33.314612 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.compute.server_external_events [req-acf51d47-67b6-412e-aaae-79c818072d34 req-d99d54b5-449a-4610-82b9-a8f3e15d0f89 service nova] Creating event network-vif-deleted:273956f8-6ada-4c24-9d33-e37b581a5bb1 for instance a392a14d-152c-467f-8031-a4bb8e36e5bb on hv-cinder-83563 May 19 21:40:33.328870 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 21:40:33.329620 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [req-acf51d47-67b6-412e-aaae-79c818072d34 req-d99d54b5-449a-4610-82b9-a8f3e15d0f89 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040532 May 19 21:40:33.330200 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Thu May 19 21:40:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 19 21:40:33.336529 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 383/778] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 21:40:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 21:40:33.421745 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-8480354d-6499-41fa-8cfd-14f60f838e50 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:40:33.422491 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-8480354d-6499-41fa-8cfd-14f60f838e50 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] [instance: a392a14d-152c-467f-8031-a4bb8e36e5bb] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:40:33.436975 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8480354d-6499-41fa-8cfd-14f60f838e50 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:40:33.437722 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8480354d-6499-41fa-8cfd-14f60f838e50 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:40:33.438814 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8480354d-6499-41fa-8cfd-14f60f838e50 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:40:33.439653 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8480354d-6499-41fa-8cfd-14f60f838e50 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:40:33.499059 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8480354d-6499-41fa-8cfd-14f60f838e50 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:40:33.499599 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8480354d-6499-41fa-8cfd-14f60f838e50 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:40:33.500135 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.objects.instance [None req-8480354d-6499-41fa-8cfd-14f60f838e50 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lazy-loading 'fault' on Instance uuid a392a14d-152c-467f-8031-a4bb8e36e5bb {{(pid=124350) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 21:40:33.548999 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-8480354d-6499-41fa-8cfd-14f60f838e50 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d16feb169ac46f7983a6b8045de77c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f5916770e9b443489fe7aa76d663fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:40:33.559065 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-8480354d-6499-41fa-8cfd-14f60f838e50 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] 10.222.0.65 "GET /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb" status: 200 len: 1327 microversion: 2.1 time: 0.143155 May 19 21:40:33.559731 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 396/779] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:40:33 2022] GET /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb => generated 1327 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:40:33.752643 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-d1b7b112-c1f8-4910-8020-bbe805138c75 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:40:33.753280 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-d1b7b112-c1f8-4910-8020-bbe805138c75 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] [instance: 89cb2230-d75e-4c8c-b47b-83f1698654dd] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:40:33.760612 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-d1b7b112-c1f8-4910-8020-bbe805138c75 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:40:33.761401 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-d1b7b112-c1f8-4910-8020-bbe805138c75 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:40:33.762361 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-d1b7b112-c1f8-4910-8020-bbe805138c75 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:40:33.763015 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-d1b7b112-c1f8-4910-8020-bbe805138c75 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:40:33.791174 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-d1b7b112-c1f8-4910-8020-bbe805138c75 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] [instance: 89cb2230-d75e-4c8c-b47b-83f1698654dd] Going to try to terminate instance {{(pid=124349) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 21:40:33.907950 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-d1b7b112-c1f8-4910-8020-bbe805138c75 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] 10.222.0.65 "DELETE /compute/v2.1/servers/89cb2230-d75e-4c8c-b47b-83f1698654dd" status: 204 len: 0 microversion: 2.1 time: 0.159973 May 19 21:40:33.909372 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 384/780] 10.222.0.65 () {58 vars in 1238 bytes} [Thu May 19 21:40:33 2022] DELETE /compute/v2.1/servers/89cb2230-d75e-4c8c-b47b-83f1698654dd => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 21:40:33.923495 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-6291769a-aa81-4783-8013-060cf2a2ca55 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:40:33.925070 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-6291769a-aa81-4783-8013-060cf2a2ca55 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] [instance: 89cb2230-d75e-4c8c-b47b-83f1698654dd] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:40:33.934766 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6291769a-aa81-4783-8013-060cf2a2ca55 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:40:33.935639 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6291769a-aa81-4783-8013-060cf2a2ca55 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:40:33.936687 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6291769a-aa81-4783-8013-060cf2a2ca55 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:40:33.937221 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6291769a-aa81-4783-8013-060cf2a2ca55 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:40:34.077395 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-6291769a-aa81-4783-8013-060cf2a2ca55 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1664dba0cd9b4d9da1e4b78691b8567e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fcf03712c6f4926a2a95dfd0519536a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:40:34.085331 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-6291769a-aa81-4783-8013-060cf2a2ca55 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] 10.222.0.65 "GET /compute/v2.1/servers/89cb2230-d75e-4c8c-b47b-83f1698654dd" status: 200 len: 1554 microversion: 2.1 time: 0.170866 May 19 21:40:34.086116 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 397/781] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:40:33 2022] GET /compute/v2.1/servers/89cb2230-d75e-4c8c-b47b-83f1698654dd => generated 1554 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:40:34.578206 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-3767abbb-4e88-4c57-93ce-5d9e40560526 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:40:34.579198 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-3767abbb-4e88-4c57-93ce-5d9e40560526 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] [instance: a392a14d-152c-467f-8031-a4bb8e36e5bb] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:40:34.589464 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-3767abbb-4e88-4c57-93ce-5d9e40560526 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:40:34.589464 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-3767abbb-4e88-4c57-93ce-5d9e40560526 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:40:34.589464 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-3767abbb-4e88-4c57-93ce-5d9e40560526 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:40:34.589464 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-3767abbb-4e88-4c57-93ce-5d9e40560526 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:40:34.621533 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-3767abbb-4e88-4c57-93ce-5d9e40560526 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:40:34.621998 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-3767abbb-4e88-4c57-93ce-5d9e40560526 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:40:34.622488 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.objects.instance [None req-3767abbb-4e88-4c57-93ce-5d9e40560526 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lazy-loading 'fault' on Instance uuid a392a14d-152c-467f-8031-a4bb8e36e5bb {{(pid=124349) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 21:40:34.669749 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-3767abbb-4e88-4c57-93ce-5d9e40560526 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d16feb169ac46f7983a6b8045de77c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f5916770e9b443489fe7aa76d663fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:40:34.680407 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-3767abbb-4e88-4c57-93ce-5d9e40560526 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] 10.222.0.65 "GET /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb" status: 200 len: 1327 microversion: 2.1 time: 0.106928 May 19 21:40:34.680980 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 385/782] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:40:34 2022] GET /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb => generated 1327 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:40:35.105428 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-8b41ef9d-6863-498d-949e-eeded0c50a41 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:40:35.106067 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-8b41ef9d-6863-498d-949e-eeded0c50a41 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] [instance: 89cb2230-d75e-4c8c-b47b-83f1698654dd] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:40:35.113984 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8b41ef9d-6863-498d-949e-eeded0c50a41 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:40:35.114460 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8b41ef9d-6863-498d-949e-eeded0c50a41 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:40:35.115305 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8b41ef9d-6863-498d-949e-eeded0c50a41 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:40:35.115759 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8b41ef9d-6863-498d-949e-eeded0c50a41 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:40:35.276395 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-8b41ef9d-6863-498d-949e-eeded0c50a41 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1664dba0cd9b4d9da1e4b78691b8567e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fcf03712c6f4926a2a95dfd0519536a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:40:35.285259 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-8b41ef9d-6863-498d-949e-eeded0c50a41 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] 10.222.0.65 "GET /compute/v2.1/servers/89cb2230-d75e-4c8c-b47b-83f1698654dd" status: 200 len: 1554 microversion: 2.1 time: 0.185747 May 19 21:40:35.285836 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 398/783] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:40:35 2022] GET /compute/v2.1/servers/89cb2230-d75e-4c8c-b47b-83f1698654dd => generated 1554 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:40:35.705222 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-d95bac53-ba3e-43dc-86e3-412356556692 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:40:35.705816 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-d95bac53-ba3e-43dc-86e3-412356556692 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] [instance: a392a14d-152c-467f-8031-a4bb8e36e5bb] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:40:35.712644 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-d95bac53-ba3e-43dc-86e3-412356556692 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:40:35.713075 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-d95bac53-ba3e-43dc-86e3-412356556692 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:40:35.713826 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-d95bac53-ba3e-43dc-86e3-412356556692 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:40:35.714278 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-d95bac53-ba3e-43dc-86e3-412356556692 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:40:35.730179 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.wsgi [None req-d95bac53-ba3e-43dc-86e3-412356556692 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] HTTP exception thrown: Instance a392a14d-152c-467f-8031-a4bb8e36e5bb could not be found. May 19 21:40:35.732099 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-d95bac53-ba3e-43dc-86e3-412356556692 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Request method failure captured: May 19 21:40:35.732099 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: request: GET /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb HTTP/1.1 May 19 21:40:35.732099 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Accept: application/json May 19 21:40:35.732099 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Accept-Encoding: identity May 19 21:40:35.732099 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Connection: close May 19 21:40:35.732099 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Content-Length: 0 May 19 21:40:35.732099 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Content-Type: application/json May 19 21:40:35.732099 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Host: 10.222.0.65 May 19 21:40:35.732099 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Openstack-System-Scope: None May 19 21:40:35.732099 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: User-Agent: python-urllib3/1.26.9 May 19 21:40:35.732099 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Auth-Token: gAAAAABihrdzwR9cl0_mageJowPPL0-Y3i1KMeew291MevSsvOTqUH9T6iei7uUBsOAIGU3BxH7b0q7g-iljM23fwskHFTiOtCziTY8T_e9-kcByALEKSIs2xltqad-aPdSyLrfb94hwo3vsyNxq18OAoSEk237HODw0VQ0Y-RzjZzfZF7bi2Oo May 19 21:40:35.732099 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Domain-Id: None May 19 21:40:35.732099 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Domain-Name: None May 19 21:40:35.732099 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Identity-Status: Confirmed May 19 21:40:35.732099 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Is-Admin-Project: True May 19 21:40:35.732099 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Project-Domain-Id: default May 19 21:40:35.732099 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Project-Domain-Name: Default May 19 21:40:35.732099 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Project-Id: 4f5916770e9b443489fe7aa76d663fe1 May 19 21:40:35.732099 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Project-Name: tempest-AttachVolumeTestJSON-1629354560 May 19 21:40:35.732099 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Role: reader,member May 19 21:40:35.732099 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Roles: reader,member May 19 21:40:35.733451 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/4f5916770e9b443489fe7aa76d663fe1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/4f5916770e9b443489fe7aa76d663fe1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_4f5916770e9b443489fe7aa76d663fe1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/4f5916770e9b443489fe7aa76d663fe1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}] May 19 21:40:35.733451 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Tenant: tempest-AttachVolumeTestJSON-1629354560 May 19 21:40:35.733451 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Tenant-Id: 4f5916770e9b443489fe7aa76d663fe1 May 19 21:40:35.733451 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1629354560 May 19 21:40:35.733451 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-User: tempest-AttachVolumeTestJSON-1629354560-project May 19 21:40:35.733451 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-User-Domain-Id: default May 19 21:40:35.733451 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-User-Domain-Name: Default May 19 21:40:35.733451 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-User-Id: 6d16feb169ac46f7983a6b8045de77c9 May 19 21:40:35.733451 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-User-Name: tempest-AttachVolumeTestJSON-1629354560-project May 19 21:40:35.733451 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: method: > May 19 21:40:35.733451 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: exception: Instance a392a14d-152c-467f-8031-a4bb8e36e5bb could not be found. May 19 21:40:35.733451 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: action_args: {'id': 'a392a14d-152c-467f-8031-a4bb8e36e5bb'} May 19 21:40:35.734274 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 21:40:35.734274 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:40:35.734274 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 21:40:35.734274 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 21:40:35.734274 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 21:40:35.734274 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 21:40:35.734274 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 21:40:35.734274 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 21:40:35.734274 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 21:40:35.734274 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 21:40:35.734274 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a392a14d-152c-467f-8031-a4bb8e36e5bb could not be found. May 19 21:40:35.734274 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:40:35.734274 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 21:40:35.734274 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:40:35.734274 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:40:35.734274 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 21:40:35.734274 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 21:40:35.734274 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 21:40:35.734274 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 21:40:35.734274 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 21:40:35.739359 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 21:40:35.739359 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 21:40:35.739359 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 21:40:35.739359 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 21:40:35.739359 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 21:40:35.739359 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 21:40:35.739359 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 21:40:35.739359 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a392a14d-152c-467f-8031-a4bb8e36e5bb could not be found. May 19 21:40:35.739359 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:40:35.739359 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 21:40:35.739359 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:40:35.739359 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:40:35.739359 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 21:40:35.739359 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 21:40:35.739359 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 21:40:35.739359 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 21:40:35.739359 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a392a14d-152c-467f-8031-a4bb8e36e5bb could not be found. May 19 21:40:35.739359 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:40:35.740708 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-d95bac53-ba3e-43dc-86e3-412356556692 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Returning 404 to user: Instance a392a14d-152c-467f-8031-a4bb8e36e5bb could not be found. {{(pid=124349) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 21:40:35.740708 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-d95bac53-ba3e-43dc-86e3-412356556692 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] 10.222.0.65 "GET /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb" status: 404 len: 111 microversion: 2.1 time: 0.033533 May 19 21:40:35.740708 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 386/784] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:40:35 2022] GET /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 21:40:35.743328 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-6f841b50-4640-42cb-9def-48c568f743d9 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Calling method '.version_select at 0x7fe3636e4550>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:40:35.763944 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-6f841b50-4640-42cb-9def-48c568f743d9 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1321638104" status: 202 len: 0 microversion: 2.1 time: 0.024221 May 19 21:40:35.764610 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 399/785] 10.222.0.65 () {58 vars in 1220 bytes} [Thu May 19 21:40:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1321638104 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 21:40:36.304174 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-0b886d37-9379-4b70-9e96-4e0cc63e46ac tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:40:36.304785 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-0b886d37-9379-4b70-9e96-4e0cc63e46ac tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] [instance: 89cb2230-d75e-4c8c-b47b-83f1698654dd] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:40:36.312716 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-0b886d37-9379-4b70-9e96-4e0cc63e46ac tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:40:36.312716 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-0b886d37-9379-4b70-9e96-4e0cc63e46ac tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:40:36.312914 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-0b886d37-9379-4b70-9e96-4e0cc63e46ac tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:40:36.313549 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-0b886d37-9379-4b70-9e96-4e0cc63e46ac tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:40:36.492891 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-41aad07e-d580-4014-bd12-8a776d766d40 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Action: 'create', calling method: .version_select at 0x7fe3636ca040>, body: {"keypair": {"name": "tempest-keypair-1307304629", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJnekXDxHHgOacWP9CrPEFiTV5552URZomu/m5scIMTYM0qNQNzQjjr2kGoM3hS+cCEu+A/XXKm3vSndZ7hY/KJ08uYqWytsQDB5UgmMQD7dnKlpe2VR6bnpdNdxsEj1sA=="}} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:40:36.523329 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.quota [None req-41aad07e-d580-4014-bd12-8a776d766d40 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Getting quotas for project 4f5916770e9b443489fe7aa76d663fe1. Resources: {'key_pairs'} {{(pid=124350) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 21:40:36.529143 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.quota [None req-41aad07e-d580-4014-bd12-8a776d766d40 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Getting quotas for user 6d16feb169ac46f7983a6b8045de77c9 and project 4f5916770e9b443489fe7aa76d663fe1. Resources: {'key_pairs'} {{(pid=124350) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 21:40:36.565788 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-41aad07e-d580-4014-bd12-8a776d766d40 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.077190 May 19 21:40:36.567298 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 400/786] 10.222.0.65 () {60 vars in 1158 bytes} [Thu May 19 21:40:36 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 21:40:36.847328 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [req-e2b74642-999a-4c79-aedd-e4a38021be88 req-682c23b9-6168-4e72-9601-d28230e3c74e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89cb2230-d75e-4c8c-b47b-83f1698654dd", "name": "network-vif-deleted", "tag": "c48b591a-ce03-49e5-b5c1-3715c76df0d6"}]} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:40:36.864700 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-e2b74642-999a-4c79-aedd-e4a38021be88 req-682c23b9-6168-4e72-9601-d28230e3c74e service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:40:36.866351 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-e2b74642-999a-4c79-aedd-e4a38021be88 req-682c23b9-6168-4e72-9601-d28230e3c74e service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:40:36.867761 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-0b886d37-9379-4b70-9e96-4e0cc63e46ac tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1664dba0cd9b4d9da1e4b78691b8567e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fcf03712c6f4926a2a95dfd0519536a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:40:36.877006 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-0b886d37-9379-4b70-9e96-4e0cc63e46ac tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] 10.222.0.65 "GET /compute/v2.1/servers/89cb2230-d75e-4c8c-b47b-83f1698654dd" status: 200 len: 1554 microversion: 2.1 time: 0.576690 May 19 21:40:36.879239 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 387/787] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:40:36 2022] GET /compute/v2.1/servers/89cb2230-d75e-4c8c-b47b-83f1698654dd => generated 1554 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:40:36.884628 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.compute.server_external_events [req-e2b74642-999a-4c79-aedd-e4a38021be88 req-682c23b9-6168-4e72-9601-d28230e3c74e service nova] Creating event network-vif-deleted:c48b591a-ce03-49e5-b5c1-3715c76df0d6 for instance 89cb2230-d75e-4c8c-b47b-83f1698654dd on hv-cinder-83563 May 19 21:40:36.893596 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [req-e2b74642-999a-4c79-aedd-e4a38021be88 req-682c23b9-6168-4e72-9601-d28230e3c74e service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051565 May 19 21:40:36.895022 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 401/788] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 21:40:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 21:40:37.895890 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-2bf8a788-c7fd-4f0c-a8bd-7ddc292953d4 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:40:37.897151 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-2bf8a788-c7fd-4f0c-a8bd-7ddc292953d4 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] [instance: 89cb2230-d75e-4c8c-b47b-83f1698654dd] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:40:37.904801 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-2bf8a788-c7fd-4f0c-a8bd-7ddc292953d4 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:40:37.905526 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-2bf8a788-c7fd-4f0c-a8bd-7ddc292953d4 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:40:37.906384 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-2bf8a788-c7fd-4f0c-a8bd-7ddc292953d4 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:40:37.906811 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-2bf8a788-c7fd-4f0c-a8bd-7ddc292953d4 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:40:37.921588 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.wsgi [None req-2bf8a788-c7fd-4f0c-a8bd-7ddc292953d4 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] HTTP exception thrown: Instance 89cb2230-d75e-4c8c-b47b-83f1698654dd could not be found. May 19 21:40:37.923448 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-2bf8a788-c7fd-4f0c-a8bd-7ddc292953d4 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Request method failure captured: May 19 21:40:37.923448 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: request: GET /compute/v2.1/servers/89cb2230-d75e-4c8c-b47b-83f1698654dd HTTP/1.1 May 19 21:40:37.923448 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Accept: application/json May 19 21:40:37.923448 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Accept-Encoding: identity May 19 21:40:37.923448 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Connection: close May 19 21:40:37.923448 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Content-Length: 0 May 19 21:40:37.923448 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Content-Type: application/json May 19 21:40:37.923448 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Host: 10.222.0.65 May 19 21:40:37.923448 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Openstack-System-Scope: None May 19 21:40:37.923448 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: User-Agent: python-urllib3/1.26.9 May 19 21:40:37.923448 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Auth-Token: gAAAAABihrfu-Pd5zRQoY2TVmCNkLGG9jG6MvWLH8iVfJ3fcF1xnJ9cnvM31NhhHWk1MVZsphJbBk6cTMrVLePjMgy6pcc8suoy-_JNF7SW-iGN6zlma3RE4OW0nBkQbrll12_Wm0W88MQzr2zyMmpJjzFxxTAf-dp1aIZfAiavDrOvadssQB24 May 19 21:40:37.923448 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Domain-Id: None May 19 21:40:37.923448 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Domain-Name: None May 19 21:40:37.923448 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Identity-Status: Confirmed May 19 21:40:37.923448 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Is-Admin-Project: True May 19 21:40:37.923448 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Project-Domain-Id: default May 19 21:40:37.923448 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Project-Domain-Name: Default May 19 21:40:37.923448 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Project-Id: 3fcf03712c6f4926a2a95dfd0519536a May 19 21:40:37.923448 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Project-Name: tempest-TestMinimumBasicScenario-1819376202 May 19 21:40:37.923448 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Role: reader,member May 19 21:40:37.923448 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Roles: reader,member May 19 21:40:37.925237 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/3fcf03712c6f4926a2a95dfd0519536a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/3fcf03712c6f4926a2a95dfd0519536a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_3fcf03712c6f4926a2a95dfd0519536a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/3fcf03712c6f4926a2a95dfd0519536a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}] May 19 21:40:37.925237 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Tenant: tempest-TestMinimumBasicScenario-1819376202 May 19 21:40:37.925237 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Tenant-Id: 3fcf03712c6f4926a2a95dfd0519536a May 19 21:40:37.925237 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1819376202 May 19 21:40:37.925237 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-User: tempest-TestMinimumBasicScenario-1819376202-project May 19 21:40:37.925237 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-User-Domain-Id: default May 19 21:40:37.925237 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-User-Domain-Name: Default May 19 21:40:37.925237 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-User-Id: 1664dba0cd9b4d9da1e4b78691b8567e May 19 21:40:37.925237 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-User-Name: tempest-TestMinimumBasicScenario-1819376202-project May 19 21:40:37.925237 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: method: > May 19 21:40:37.925237 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: exception: Instance 89cb2230-d75e-4c8c-b47b-83f1698654dd could not be found. May 19 21:40:37.925237 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: action_args: {'id': '89cb2230-d75e-4c8c-b47b-83f1698654dd'} May 19 21:40:37.927843 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 21:40:37.927843 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:40:37.927843 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 21:40:37.927843 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 21:40:37.927843 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 21:40:37.927843 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 21:40:37.927843 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 21:40:37.927843 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 21:40:37.927843 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 21:40:37.927843 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 21:40:37.927843 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89cb2230-d75e-4c8c-b47b-83f1698654dd could not be found. May 19 21:40:37.927843 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:40:37.927843 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 21:40:37.927843 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:40:37.927843 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:40:37.927843 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 21:40:37.927843 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 21:40:37.927843 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 21:40:37.927843 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 21:40:37.927843 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 21:40:37.930000 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 21:40:37.930000 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 21:40:37.930000 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 21:40:37.930000 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 21:40:37.930000 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 21:40:37.930000 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 21:40:37.930000 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 21:40:37.930000 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89cb2230-d75e-4c8c-b47b-83f1698654dd could not be found. May 19 21:40:37.930000 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:40:37.930000 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 21:40:37.930000 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:40:37.930000 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:40:37.930000 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 21:40:37.930000 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 21:40:37.930000 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 21:40:37.930000 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 21:40:37.930000 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89cb2230-d75e-4c8c-b47b-83f1698654dd could not be found. May 19 21:40:37.930000 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:40:37.932717 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-2bf8a788-c7fd-4f0c-a8bd-7ddc292953d4 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Returning 404 to user: Instance 89cb2230-d75e-4c8c-b47b-83f1698654dd could not be found. {{(pid=124349) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 21:40:37.932717 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-2bf8a788-c7fd-4f0c-a8bd-7ddc292953d4 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] 10.222.0.65 "GET /compute/v2.1/servers/89cb2230-d75e-4c8c-b47b-83f1698654dd" status: 404 len: 111 microversion: 2.1 time: 0.033015 May 19 21:40:37.932717 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 388/789] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:40:37 2022] GET /compute/v2.1/servers/89cb2230-d75e-4c8c-b47b-83f1698654dd => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 21:40:37.934827 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-248da86a-9d0e-4824-89d3-455bf3467f94 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] Calling method '.version_select at 0x7fe3636e4a60>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:40:37.954683 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-248da86a-9d0e-4824-89d3-455bf3467f94 tempest-TestMinimumBasicScenario-1819376202 tempest-TestMinimumBasicScenario-1819376202-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1602403806" status: 202 len: 0 microversion: 2.1 time: 0.024414 May 19 21:40:37.955408 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 402/790] 10.222.0.65 () {58 vars in 1271 bytes} [Thu May 19 21:40:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1602403806 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 19 21:40:38.492177 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-55cd60bd-ca8f-4751-9696-db12eac584eb tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-599684845", "imageRef": "a874457a-f8a8-46f6-bdcc-1fa632a0d3c0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b9d96816-1157-468c-bb81-22f27d368a2b"}], "security_groups": [{"name": "tempest-securitygroup--532724449"}], "key_name": "tempest-keypair-1307304629", "user_data": "}} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:40:38.610846 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.network.neutron [None req-55cd60bd-ca8f-4751-9696-db12eac584eb tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] validate_networks() for [('b9d96816-1157-468c-bb81-22f27d368a2b', None, None, None, None, None)] {{(pid=124349) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 19 21:40:39.097668 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.virt.hardware [None req-55cd60bd-ca8f-4751-9696-db12eac584eb tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Flavor limits 0:0:0 {{(pid=124349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 21:40:39.098279 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.virt.hardware [None req-55cd60bd-ca8f-4751-9696-db12eac584eb tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Image limits 0:0:0 {{(pid=124349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 21:40:39.098560 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.virt.hardware [None req-55cd60bd-ca8f-4751-9696-db12eac584eb tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Flavor pref 0:0:0 {{(pid=124349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 21:40:39.098959 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.virt.hardware [None req-55cd60bd-ca8f-4751-9696-db12eac584eb tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Image pref 0:0:0 {{(pid=124349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 21:40:39.099753 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.virt.hardware [None req-55cd60bd-ca8f-4751-9696-db12eac584eb tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 21:40:39.110800 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-55cd60bd-ca8f-4751-9696-db12eac584eb tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:40:39.111247 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-55cd60bd-ca8f-4751-9696-db12eac584eb tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:40:39.112052 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-55cd60bd-ca8f-4751-9696-db12eac584eb tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:40:39.112488 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-55cd60bd-ca8f-4751-9696-db12eac584eb tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:40:39.130158 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.quota [None req-55cd60bd-ca8f-4751-9696-db12eac584eb tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Getting quotas for project 4f5916770e9b443489fe7aa76d663fe1. Resources: {'ram', 'cores', 'instances'} {{(pid=124349) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 21:40:39.135638 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.quota [None req-55cd60bd-ca8f-4751-9696-db12eac584eb tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Getting quotas for user 6d16feb169ac46f7983a6b8045de77c9 and project 4f5916770e9b443489fe7aa76d663fe1. Resources: {'ram', 'cores', 'instances'} {{(pid=124349) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 21:40:39.151408 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-55cd60bd-ca8f-4751-9696-db12eac584eb tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Going to run 1 instances... {{(pid=124349) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 21:40:39.156557 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-55cd60bd-ca8f-4751-9696-db12eac584eb tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] [instance: c9b67820-7cf5-4a53-9394-c967b6fc2975] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a874457a-f8a8-46f6-bdcc-1fa632a0d3c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124349) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 21:40:39.208523 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-55cd60bd-ca8f-4751-9696-db12eac584eb tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.721633 May 19 21:40:39.214004 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 389/791] 10.222.0.65 () {60 vars in 1146 bytes} [Thu May 19 21:40:38 2022] POST /compute/v2.1/servers => generated 401 bytes in 723 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 21:40:39.220558 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-ea383196-a76d-46ed-9458-d4720db56641 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:40:39.221187 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-ea383196-a76d-46ed-9458-d4720db56641 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] [instance: c9b67820-7cf5-4a53-9394-c967b6fc2975] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:40:39.283815 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-ea383196-a76d-46ed-9458-d4720db56641 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d16feb169ac46f7983a6b8045de77c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f5916770e9b443489fe7aa76d663fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:40:39.291925 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-ea383196-a76d-46ed-9458-d4720db56641 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] 10.222.0.65 "GET /compute/v2.1/servers/c9b67820-7cf5-4a53-9394-c967b6fc2975" status: 200 len: 1237 microversion: 2.1 time: 0.076163 May 19 21:40:39.301734 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 403/792] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:40:39 2022] GET /compute/v2.1/servers/c9b67820-7cf5-4a53-9394-c967b6fc2975 => generated 1237 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:40:40.312073 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-3aae8d6d-f010-4903-b861-6370fc7a3df7 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:40:40.312766 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-3aae8d6d-f010-4903-b861-6370fc7a3df7 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] [instance: c9b67820-7cf5-4a53-9394-c967b6fc2975] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:40:40.319969 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-3aae8d6d-f010-4903-b861-6370fc7a3df7 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:40:40.320410 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-3aae8d6d-f010-4903-b861-6370fc7a3df7 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:40:40.321329 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-3aae8d6d-f010-4903-b861-6370fc7a3df7 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:40:40.321741 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-3aae8d6d-f010-4903-b861-6370fc7a3df7 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:40:40.424287 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-3aae8d6d-f010-4903-b861-6370fc7a3df7 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d16feb169ac46f7983a6b8045de77c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f5916770e9b443489fe7aa76d663fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:40:40.436138 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-3aae8d6d-f010-4903-b861-6370fc7a3df7 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] 10.222.0.65 "GET /compute/v2.1/servers/c9b67820-7cf5-4a53-9394-c967b6fc2975" status: 200 len: 1307 microversion: 2.1 time: 0.130562 May 19 21:40:40.436720 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 390/793] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:40:40 2022] GET /compute/v2.1/servers/c9b67820-7cf5-4a53-9394-c967b6fc2975 => generated 1307 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:40:41.455649 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-2f170754-4ce4-4a3c-9342-65b222181634 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:40:41.456338 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-2f170754-4ce4-4a3c-9342-65b222181634 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] [instance: c9b67820-7cf5-4a53-9394-c967b6fc2975] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:40:41.463344 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2f170754-4ce4-4a3c-9342-65b222181634 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:40:41.463846 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2f170754-4ce4-4a3c-9342-65b222181634 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:40:41.464674 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2f170754-4ce4-4a3c-9342-65b222181634 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:40:41.465163 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2f170754-4ce4-4a3c-9342-65b222181634 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:40:41.529156 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-2f170754-4ce4-4a3c-9342-65b222181634 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d16feb169ac46f7983a6b8045de77c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f5916770e9b443489fe7aa76d663fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:40:41.537117 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-2f170754-4ce4-4a3c-9342-65b222181634 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] 10.222.0.65 "GET /compute/v2.1/servers/c9b67820-7cf5-4a53-9394-c967b6fc2975" status: 200 len: 1295 microversion: 2.1 time: 0.087815 May 19 21:40:41.538000 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 404/794] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:40:41 2022] GET /compute/v2.1/servers/c9b67820-7cf5-4a53-9394-c967b6fc2975 => generated 1295 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:40:42.555251 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-a97ed575-7ca7-4e42-bbe5-8933465a5e6f tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:40:42.555812 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-a97ed575-7ca7-4e42-bbe5-8933465a5e6f tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] [instance: c9b67820-7cf5-4a53-9394-c967b6fc2975] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:40:42.563229 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a97ed575-7ca7-4e42-bbe5-8933465a5e6f tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:40:42.563667 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a97ed575-7ca7-4e42-bbe5-8933465a5e6f tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:40:42.564441 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a97ed575-7ca7-4e42-bbe5-8933465a5e6f tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:40:42.564873 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a97ed575-7ca7-4e42-bbe5-8933465a5e6f tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:40:42.644321 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-a97ed575-7ca7-4e42-bbe5-8933465a5e6f tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d16feb169ac46f7983a6b8045de77c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f5916770e9b443489fe7aa76d663fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:40:42.652192 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-a97ed575-7ca7-4e42-bbe5-8933465a5e6f tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] 10.222.0.65 "GET /compute/v2.1/servers/c9b67820-7cf5-4a53-9394-c967b6fc2975" status: 200 len: 1295 microversion: 2.1 time: 0.101204 May 19 21:40:42.652775 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 391/795] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:40:42 2022] GET /compute/v2.1/servers/c9b67820-7cf5-4a53-9394-c967b6fc2975 => generated 1295 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:40:43.669725 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-a2437b3c-6073-49f0-983f-41a7885764b0 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:40:43.670358 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-a2437b3c-6073-49f0-983f-41a7885764b0 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] [instance: c9b67820-7cf5-4a53-9394-c967b6fc2975] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:40:43.681027 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a2437b3c-6073-49f0-983f-41a7885764b0 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:40:43.681806 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a2437b3c-6073-49f0-983f-41a7885764b0 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:40:43.682881 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a2437b3c-6073-49f0-983f-41a7885764b0 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:40:43.683300 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a2437b3c-6073-49f0-983f-41a7885764b0 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:40:43.760062 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-a2437b3c-6073-49f0-983f-41a7885764b0 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d16feb169ac46f7983a6b8045de77c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f5916770e9b443489fe7aa76d663fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:40:43.780681 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-a2437b3c-6073-49f0-983f-41a7885764b0 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] 10.222.0.65 "GET /compute/v2.1/servers/c9b67820-7cf5-4a53-9394-c967b6fc2975" status: 200 len: 1295 microversion: 2.1 time: 0.114777 May 19 21:40:43.782159 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 405/796] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:40:43 2022] GET /compute/v2.1/servers/c9b67820-7cf5-4a53-9394-c967b6fc2975 => generated 1295 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:40:44.800714 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-c5d501a3-58c8-4f0a-ba13-f8fa70eac9cd tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:40:44.801328 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-c5d501a3-58c8-4f0a-ba13-f8fa70eac9cd tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] [instance: c9b67820-7cf5-4a53-9394-c967b6fc2975] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:40:44.818089 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c5d501a3-58c8-4f0a-ba13-f8fa70eac9cd tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:40:44.819012 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c5d501a3-58c8-4f0a-ba13-f8fa70eac9cd tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:40:44.821403 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c5d501a3-58c8-4f0a-ba13-f8fa70eac9cd tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:40:44.821852 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c5d501a3-58c8-4f0a-ba13-f8fa70eac9cd tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:40:44.826846 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:40:45.157604 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-c5d501a3-58c8-4f0a-ba13-f8fa70eac9cd tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d16feb169ac46f7983a6b8045de77c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f5916770e9b443489fe7aa76d663fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:40:45.194563 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-c5d501a3-58c8-4f0a-ba13-f8fa70eac9cd tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] 10.222.0.65 "GET /compute/v2.1/servers/c9b67820-7cf5-4a53-9394-c967b6fc2975" status: 200 len: 1362 microversion: 2.1 time: 0.400506 May 19 21:40:45.196416 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 392/797] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:40:44 2022] GET /compute/v2.1/servers/c9b67820-7cf5-4a53-9394-c967b6fc2975 => generated 1362 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:40:46.013626 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [req-5760f80d-c6db-494c-b962-3d8be4549eb0 req-afd835fd-370c-4903-a636-dcb68bfa2180 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9b67820-7cf5-4a53-9394-c967b6fc2975", "tag": "aaef1770-d4d0-45c5-a159-84af9d8f2b97"}]} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:40:46.061673 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-5760f80d-c6db-494c-b962-3d8be4549eb0 req-afd835fd-370c-4903-a636-dcb68bfa2180 service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:40:46.068465 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-5760f80d-c6db-494c-b962-3d8be4549eb0 req-afd835fd-370c-4903-a636-dcb68bfa2180 service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:40:46.102544 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.compute.server_external_events [req-5760f80d-c6db-494c-b962-3d8be4549eb0 req-afd835fd-370c-4903-a636-dcb68bfa2180 service nova] Creating event network-changed:aaef1770-d4d0-45c5-a159-84af9d8f2b97 for instance c9b67820-7cf5-4a53-9394-c967b6fc2975 on hv-cinder-83563 May 19 21:40:46.108762 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [req-5760f80d-c6db-494c-b962-3d8be4549eb0 req-afd835fd-370c-4903-a636-dcb68bfa2180 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112088 May 19 21:40:46.109756 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 406/798] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 21:40:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 21:40:46.218025 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-104f8296-d500-4895-ba87-4a3d1ee5747b tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:40:46.218801 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-104f8296-d500-4895-ba87-4a3d1ee5747b tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] [instance: c9b67820-7cf5-4a53-9394-c967b6fc2975] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:40:46.231331 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-104f8296-d500-4895-ba87-4a3d1ee5747b tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:40:46.232187 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-104f8296-d500-4895-ba87-4a3d1ee5747b tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:40:46.233182 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-104f8296-d500-4895-ba87-4a3d1ee5747b tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:40:46.233619 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-104f8296-d500-4895-ba87-4a3d1ee5747b tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:40:46.615943 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-104f8296-d500-4895-ba87-4a3d1ee5747b tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d16feb169ac46f7983a6b8045de77c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f5916770e9b443489fe7aa76d663fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:40:46.629392 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-104f8296-d500-4895-ba87-4a3d1ee5747b tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] 10.222.0.65 "GET /compute/v2.1/servers/c9b67820-7cf5-4a53-9394-c967b6fc2975" status: 200 len: 1362 microversion: 2.1 time: 0.419142 May 19 21:40:46.630279 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 393/799] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:40:46 2022] GET /compute/v2.1/servers/c9b67820-7cf5-4a53-9394-c967b6fc2975 => generated 1362 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:40:47.652276 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-41c4417c-5da1-4fe9-a885-4c77fe46842b tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:40:47.653119 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-41c4417c-5da1-4fe9-a885-4c77fe46842b tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] [instance: c9b67820-7cf5-4a53-9394-c967b6fc2975] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:40:47.662088 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-41c4417c-5da1-4fe9-a885-4c77fe46842b tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:40:47.662669 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-41c4417c-5da1-4fe9-a885-4c77fe46842b tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:40:47.663660 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-41c4417c-5da1-4fe9-a885-4c77fe46842b tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:40:47.664097 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-41c4417c-5da1-4fe9-a885-4c77fe46842b tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:40:47.839280 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-41c4417c-5da1-4fe9-a885-4c77fe46842b tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d16feb169ac46f7983a6b8045de77c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f5916770e9b443489fe7aa76d663fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:40:47.866289 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-41c4417c-5da1-4fe9-a885-4c77fe46842b tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] 10.222.0.65 "GET /compute/v2.1/servers/c9b67820-7cf5-4a53-9394-c967b6fc2975" status: 200 len: 1362 microversion: 2.1 time: 0.220572 May 19 21:40:47.866875 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 407/800] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:40:47 2022] GET /compute/v2.1/servers/c9b67820-7cf5-4a53-9394-c967b6fc2975 => generated 1362 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:40:48.887614 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-ef12ba3a-84e6-465a-9420-14fe0964d527 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:40:48.888231 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-ef12ba3a-84e6-465a-9420-14fe0964d527 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] [instance: c9b67820-7cf5-4a53-9394-c967b6fc2975] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:40:48.895259 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ef12ba3a-84e6-465a-9420-14fe0964d527 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:40:48.895712 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ef12ba3a-84e6-465a-9420-14fe0964d527 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:40:48.896516 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ef12ba3a-84e6-465a-9420-14fe0964d527 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:40:48.897049 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ef12ba3a-84e6-465a-9420-14fe0964d527 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:40:49.048522 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-ef12ba3a-84e6-465a-9420-14fe0964d527 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d16feb169ac46f7983a6b8045de77c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f5916770e9b443489fe7aa76d663fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:40:49.056534 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-ef12ba3a-84e6-465a-9420-14fe0964d527 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] 10.222.0.65 "GET /compute/v2.1/servers/c9b67820-7cf5-4a53-9394-c967b6fc2975" status: 200 len: 1362 microversion: 2.1 time: 0.172779 May 19 21:40:49.057128 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 394/801] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:40:48 2022] GET /compute/v2.1/servers/c9b67820-7cf5-4a53-9394-c967b6fc2975 => generated 1362 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:40:50.075827 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-47d37d8e-cbd6-47af-aa88-ae53a25e3634 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:40:50.076545 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-47d37d8e-cbd6-47af-aa88-ae53a25e3634 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] [instance: c9b67820-7cf5-4a53-9394-c967b6fc2975] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:40:50.080543 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell0:SELECT=6 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:40:50.084618 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-47d37d8e-cbd6-47af-aa88-ae53a25e3634 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:40:50.085117 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-47d37d8e-cbd6-47af-aa88-ae53a25e3634 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:40:50.085837 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-47d37d8e-cbd6-47af-aa88-ae53a25e3634 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:40:50.086288 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-47d37d8e-cbd6-47af-aa88-ae53a25e3634 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:40:50.240704 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-47d37d8e-cbd6-47af-aa88-ae53a25e3634 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d16feb169ac46f7983a6b8045de77c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f5916770e9b443489fe7aa76d663fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:40:50.252872 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-47d37d8e-cbd6-47af-aa88-ae53a25e3634 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] 10.222.0.65 "GET /compute/v2.1/servers/c9b67820-7cf5-4a53-9394-c967b6fc2975" status: 200 len: 1362 microversion: 2.1 time: 0.181846 May 19 21:40:50.253554 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 408/802] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:40:50 2022] GET /compute/v2.1/servers/c9b67820-7cf5-4a53-9394-c967b6fc2975 => generated 1362 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:40:51.274634 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-0789d987-c8b5-4444-b0f8-c7c2a20e6120 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:40:51.277385 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-0789d987-c8b5-4444-b0f8-c7c2a20e6120 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] [instance: c9b67820-7cf5-4a53-9394-c967b6fc2975] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:40:51.281490 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_cell0:SELECT=2 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:40:51.283104 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_cell0:SELECT=6 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:40:51.295482 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-0789d987-c8b5-4444-b0f8-c7c2a20e6120 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:40:51.296157 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-0789d987-c8b5-4444-b0f8-c7c2a20e6120 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:40:51.297255 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-0789d987-c8b5-4444-b0f8-c7c2a20e6120 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:40:51.297876 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-0789d987-c8b5-4444-b0f8-c7c2a20e6120 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:40:51.495540 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-0789d987-c8b5-4444-b0f8-c7c2a20e6120 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d16feb169ac46f7983a6b8045de77c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f5916770e9b443489fe7aa76d663fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:40:51.503909 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-0789d987-c8b5-4444-b0f8-c7c2a20e6120 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] 10.222.0.65 "GET /compute/v2.1/servers/c9b67820-7cf5-4a53-9394-c967b6fc2975" status: 200 len: 1362 microversion: 2.1 time: 0.237321 May 19 21:40:51.504499 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 395/803] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:40:51 2022] GET /compute/v2.1/servers/c9b67820-7cf5-4a53-9394-c967b6fc2975 => generated 1362 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:40:52.527040 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-c51132df-c0e0-4877-9037-f414bb88700b tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:40:52.527630 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-c51132df-c0e0-4877-9037-f414bb88700b tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] [instance: c9b67820-7cf5-4a53-9394-c967b6fc2975] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:40:52.534996 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c51132df-c0e0-4877-9037-f414bb88700b tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:40:52.535426 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c51132df-c0e0-4877-9037-f414bb88700b tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:40:52.536224 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c51132df-c0e0-4877-9037-f414bb88700b tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:40:52.537251 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c51132df-c0e0-4877-9037-f414bb88700b tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:40:52.699450 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-c51132df-c0e0-4877-9037-f414bb88700b tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d16feb169ac46f7983a6b8045de77c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f5916770e9b443489fe7aa76d663fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:40:52.708158 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-c51132df-c0e0-4877-9037-f414bb88700b tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] 10.222.0.65 "GET /compute/v2.1/servers/c9b67820-7cf5-4a53-9394-c967b6fc2975" status: 200 len: 1362 microversion: 2.1 time: 0.185051 May 19 21:40:52.708742 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 409/804] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:40:52 2022] GET /compute/v2.1/servers/c9b67820-7cf5-4a53-9394-c967b6fc2975 => generated 1362 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:40:52.871181 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [req-c82b0615-2f0a-47b0-b2c5-f99794d50e25 req-ab0c663b-09fc-488d-9485-dad596251ce5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9b67820-7cf5-4a53-9394-c967b6fc2975", "name": "network-vif-plugged", "status": "completed", "tag": "aaef1770-d4d0-45c5-a159-84af9d8f2b97"}]} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:40:52.882532 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-c82b0615-2f0a-47b0-b2c5-f99794d50e25 req-ab0c663b-09fc-488d-9485-dad596251ce5 service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:40:52.883088 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-c82b0615-2f0a-47b0-b2c5-f99794d50e25 req-ab0c663b-09fc-488d-9485-dad596251ce5 service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:40:53.064735 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.compute.server_external_events [req-c82b0615-2f0a-47b0-b2c5-f99794d50e25 req-ab0c663b-09fc-488d-9485-dad596251ce5 service nova] Creating event network-vif-plugged:aaef1770-d4d0-45c5-a159-84af9d8f2b97 for instance c9b67820-7cf5-4a53-9394-c967b6fc2975 on hv-cinder-83563 May 19 21:40:53.070419 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [req-c82b0615-2f0a-47b0-b2c5-f99794d50e25 req-ab0c663b-09fc-488d-9485-dad596251ce5 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.204448 May 19 21:40:53.071127 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 396/805] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 21:40:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 21:40:53.725530 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-4d924a93-bf84-4c99-b918-40e15625967f tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:40:53.726638 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-4d924a93-bf84-4c99-b918-40e15625967f tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] [instance: c9b67820-7cf5-4a53-9394-c967b6fc2975] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:40:53.734525 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4d924a93-bf84-4c99-b918-40e15625967f tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:40:53.734975 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4d924a93-bf84-4c99-b918-40e15625967f tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:40:53.735778 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4d924a93-bf84-4c99-b918-40e15625967f tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:40:53.736197 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4d924a93-bf84-4c99-b918-40e15625967f tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:40:53.900275 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-4d924a93-bf84-4c99-b918-40e15625967f tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d16feb169ac46f7983a6b8045de77c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f5916770e9b443489fe7aa76d663fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:40:53.909841 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-4d924a93-bf84-4c99-b918-40e15625967f tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] 10.222.0.65 "GET /compute/v2.1/servers/c9b67820-7cf5-4a53-9394-c967b6fc2975" status: 200 len: 1362 microversion: 2.1 time: 0.188375 May 19 21:40:53.910682 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 410/806] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:40:53 2022] GET /compute/v2.1/servers/c9b67820-7cf5-4a53-9394-c967b6fc2975 => generated 1362 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:40:54.931397 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-76b7f0be-d3d1-4eee-b89d-cfc1e60eda73 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:40:54.932111 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-76b7f0be-d3d1-4eee-b89d-cfc1e60eda73 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] [instance: c9b67820-7cf5-4a53-9394-c967b6fc2975] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:40:54.939748 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-76b7f0be-d3d1-4eee-b89d-cfc1e60eda73 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:40:54.940197 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-76b7f0be-d3d1-4eee-b89d-cfc1e60eda73 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:40:54.940973 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-76b7f0be-d3d1-4eee-b89d-cfc1e60eda73 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:40:54.941402 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-76b7f0be-d3d1-4eee-b89d-cfc1e60eda73 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:40:55.110654 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-76b7f0be-d3d1-4eee-b89d-cfc1e60eda73 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d16feb169ac46f7983a6b8045de77c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f5916770e9b443489fe7aa76d663fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:40:55.119881 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-76b7f0be-d3d1-4eee-b89d-cfc1e60eda73 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] 10.222.0.65 "GET /compute/v2.1/servers/c9b67820-7cf5-4a53-9394-c967b6fc2975" status: 200 len: 1362 microversion: 2.1 time: 0.194192 May 19 21:40:55.120483 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 397/807] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:40:54 2022] GET /compute/v2.1/servers/c9b67820-7cf5-4a53-9394-c967b6fc2975 => generated 1362 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:40:56.139453 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-e83f1680-cb5e-43a4-ba93-5449bdb166f8 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:40:56.140211 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-e83f1680-cb5e-43a4-ba93-5449bdb166f8 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] [instance: c9b67820-7cf5-4a53-9394-c967b6fc2975] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:40:56.148311 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e83f1680-cb5e-43a4-ba93-5449bdb166f8 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:40:56.148760 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e83f1680-cb5e-43a4-ba93-5449bdb166f8 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:40:56.149844 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e83f1680-cb5e-43a4-ba93-5449bdb166f8 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:40:56.150272 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e83f1680-cb5e-43a4-ba93-5449bdb166f8 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:40:56.324195 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-e83f1680-cb5e-43a4-ba93-5449bdb166f8 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d16feb169ac46f7983a6b8045de77c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f5916770e9b443489fe7aa76d663fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:40:56.333193 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-e83f1680-cb5e-43a4-ba93-5449bdb166f8 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] 10.222.0.65 "GET /compute/v2.1/servers/c9b67820-7cf5-4a53-9394-c967b6fc2975" status: 200 len: 1549 microversion: 2.1 time: 0.198644 May 19 21:40:56.333769 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 411/808] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:40:56 2022] GET /compute/v2.1/servers/c9b67820-7cf5-4a53-9394-c967b6fc2975 => generated 1549 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:40:56.351649 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-e5b8aa8d-21d9-46f2-9ea5-4b8ee3c88587 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:40:56.352800 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-e5b8aa8d-21d9-46f2-9ea5-4b8ee3c88587 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] [instance: c9b67820-7cf5-4a53-9394-c967b6fc2975] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:40:56.359922 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e5b8aa8d-21d9-46f2-9ea5-4b8ee3c88587 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:40:56.360383 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e5b8aa8d-21d9-46f2-9ea5-4b8ee3c88587 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:40:56.361175 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e5b8aa8d-21d9-46f2-9ea5-4b8ee3c88587 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:40:56.361608 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e5b8aa8d-21d9-46f2-9ea5-4b8ee3c88587 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:40:56.746998 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-e5b8aa8d-21d9-46f2-9ea5-4b8ee3c88587 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] 10.222.0.65 "GET /compute/v2.1/servers/c9b67820-7cf5-4a53-9394-c967b6fc2975/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.399162 May 19 21:40:56.747990 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 398/809] 10.222.0.65 () {58 vars in 1274 bytes} [Thu May 19 21:40:56 2022] GET /compute/v2.1/servers/c9b67820-7cf5-4a53-9394-c967b6fc2975/os-interface => generated 285 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 21:40:58.222258 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [req-3d81a9fa-9444-4781-b7f2-6bfa863a0a6e req-0231a214-702f-4e4d-adbb-68a19a9447ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9b67820-7cf5-4a53-9394-c967b6fc2975", "tag": "aaef1770-d4d0-45c5-a159-84af9d8f2b97"}]} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:40:58.232832 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-3d81a9fa-9444-4781-b7f2-6bfa863a0a6e req-0231a214-702f-4e4d-adbb-68a19a9447ea service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:40:58.233581 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-3d81a9fa-9444-4781-b7f2-6bfa863a0a6e req-0231a214-702f-4e4d-adbb-68a19a9447ea service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:40:58.256914 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.compute.server_external_events [req-3d81a9fa-9444-4781-b7f2-6bfa863a0a6e req-0231a214-702f-4e4d-adbb-68a19a9447ea service nova] Creating event network-changed:aaef1770-d4d0-45c5-a159-84af9d8f2b97 for instance c9b67820-7cf5-4a53-9394-c967b6fc2975 on hv-cinder-83563 May 19 21:40:58.265760 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [req-3d81a9fa-9444-4781-b7f2-6bfa863a0a6e req-0231a214-702f-4e4d-adbb-68a19a9447ea service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055068 May 19 21:40:58.266857 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 412/810] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 21:40:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 21:41:20.113945 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:41:20.115201 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_cell1:SELECT=34 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:41:20.121796 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-cb9b72e0-b18b-45a3-9ffe-e60affd578c9 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:41:20.122444 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-cb9b72e0-b18b-45a3-9ffe-e60affd578c9 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: 446bb786-0ec7-4542-9509-36282d7126c8] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:41:20.132406 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-cb9b72e0-b18b-45a3-9ffe-e60affd578c9 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:41:20.133142 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-cb9b72e0-b18b-45a3-9ffe-e60affd578c9 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:41:20.134291 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-cb9b72e0-b18b-45a3-9ffe-e60affd578c9 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:41:20.134795 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-cb9b72e0-b18b-45a3-9ffe-e60affd578c9 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:41:20.170755 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-cb9b72e0-b18b-45a3-9ffe-e60affd578c9 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8/ips" status: 200 len: 153 microversion: 2.20 time: 0.059731 May 19 21:41:20.171438 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 399/811] 10.222.0.65 () {60 vars in 1288 bytes} [Thu May 19 21:41:20 2022] GET /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8/ips => generated 153 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 21:41:22.130166 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_api:SELECT=61,nova_api:DELETE=2,nova_api:INSERT=1 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:41:22.131147 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell1:SELECT=96 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:41:22.136243 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-deed1b5a-309a-4590-88ae-db5dba7def0d tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:41:22.136998 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-deed1b5a-309a-4590-88ae-db5dba7def0d tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: 446bb786-0ec7-4542-9509-36282d7126c8] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:41:22.145506 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-deed1b5a-309a-4590-88ae-db5dba7def0d tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:41:22.145948 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-deed1b5a-309a-4590-88ae-db5dba7def0d tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:41:22.146771 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-deed1b5a-309a-4590-88ae-db5dba7def0d tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:41:22.147206 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-deed1b5a-309a-4590-88ae-db5dba7def0d tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:41:22.193509 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.objects.instance [None req-deed1b5a-309a-4590-88ae-db5dba7def0d tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lazy-loading 'flavor' on Instance uuid 446bb786-0ec7-4542-9509-36282d7126c8 {{(pid=124350) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 21:41:22.515099 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-deed1b5a-309a-4590-88ae-db5dba7def0d tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "POST /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8/action" status: 202 len: 0 microversion: 2.20 time: 0.386423 May 19 21:41:22.516516 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 413/812] 10.222.0.65 () {62 vars in 1318 bytes} [Thu May 19 21:41:22 2022] POST /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8/action => generated 0 bytes in 388 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 19 21:41:22.524884 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-63e3fb99-85d2-47ef-a7b6-eeda6e640c1e tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:41:22.525804 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-63e3fb99-85d2-47ef-a7b6-eeda6e640c1e tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: 446bb786-0ec7-4542-9509-36282d7126c8] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:41:22.533690 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-63e3fb99-85d2-47ef-a7b6-eeda6e640c1e tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:41:22.534136 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-63e3fb99-85d2-47ef-a7b6-eeda6e640c1e tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:41:22.534981 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-63e3fb99-85d2-47ef-a7b6-eeda6e640c1e tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:41:22.535461 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-63e3fb99-85d2-47ef-a7b6-eeda6e640c1e tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:41:22.723544 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-63e3fb99-85d2-47ef-a7b6-eeda6e640c1e tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:41:22.733503 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-63e3fb99-85d2-47ef-a7b6-eeda6e640c1e tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:41:22.735027 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-63e3fb99-85d2-47ef-a7b6-eeda6e640c1e tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:41:22.736516 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-63e3fb99-85d2-47ef-a7b6-eeda6e640c1e tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8" status: 200 len: 1724 microversion: 2.20 time: 0.215824 May 19 21:41:22.737087 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 400/813] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:41:22 2022] GET /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8 => generated 1724 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:41:23.763920 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-2cccf315-adf1-45a6-bba6-480e407e8de7 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:41:23.764932 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-2cccf315-adf1-45a6-bba6-480e407e8de7 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: 446bb786-0ec7-4542-9509-36282d7126c8] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:41:23.776276 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2cccf315-adf1-45a6-bba6-480e407e8de7 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:41:23.777051 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2cccf315-adf1-45a6-bba6-480e407e8de7 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:41:23.778531 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2cccf315-adf1-45a6-bba6-480e407e8de7 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:41:23.779302 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2cccf315-adf1-45a6-bba6-480e407e8de7 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:41:23.992921 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-2cccf315-adf1-45a6-bba6-480e407e8de7 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:41:24.004413 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-2cccf315-adf1-45a6-bba6-480e407e8de7 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:41:24.005980 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-2cccf315-adf1-45a6-bba6-480e407e8de7 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:41:24.007186 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-2cccf315-adf1-45a6-bba6-480e407e8de7 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8" status: 200 len: 1724 microversion: 2.20 time: 0.253369 May 19 21:41:24.007784 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 414/814] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:41:23 2022] GET /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8 => generated 1724 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:41:25.028298 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-322986da-49ef-48ab-8575-42803a60ce72 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:41:25.029224 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-322986da-49ef-48ab-8575-42803a60ce72 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: 446bb786-0ec7-4542-9509-36282d7126c8] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:41:25.036930 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-322986da-49ef-48ab-8575-42803a60ce72 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:41:25.037383 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-322986da-49ef-48ab-8575-42803a60ce72 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:41:25.038212 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-322986da-49ef-48ab-8575-42803a60ce72 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:41:25.038671 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-322986da-49ef-48ab-8575-42803a60ce72 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:41:25.256277 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-322986da-49ef-48ab-8575-42803a60ce72 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:41:25.267515 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-322986da-49ef-48ab-8575-42803a60ce72 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:41:25.270357 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-322986da-49ef-48ab-8575-42803a60ce72 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:41:25.272435 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-322986da-49ef-48ab-8575-42803a60ce72 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8" status: 200 len: 1724 microversion: 2.20 time: 0.248001 May 19 21:41:25.273369 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 401/815] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:41:25 2022] GET /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8 => generated 1724 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:41:26.301791 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-59efecd1-bacd-4920-a69a-a61af15568fb tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:41:26.302952 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-59efecd1-bacd-4920-a69a-a61af15568fb tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: 446bb786-0ec7-4542-9509-36282d7126c8] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:41:26.320907 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-59efecd1-bacd-4920-a69a-a61af15568fb tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:41:26.321990 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-59efecd1-bacd-4920-a69a-a61af15568fb tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:41:26.323769 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-59efecd1-bacd-4920-a69a-a61af15568fb tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:41:26.324612 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-59efecd1-bacd-4920-a69a-a61af15568fb tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:41:26.539000 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-59efecd1-bacd-4920-a69a-a61af15568fb tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:41:26.556419 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-59efecd1-bacd-4920-a69a-a61af15568fb tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:41:26.557930 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-59efecd1-bacd-4920-a69a-a61af15568fb tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:41:26.560063 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-59efecd1-bacd-4920-a69a-a61af15568fb tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8" status: 200 len: 1724 microversion: 2.20 time: 0.267758 May 19 21:41:26.560659 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 415/816] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:41:26 2022] GET /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8 => generated 1724 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:41:27.583080 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-6a57efed-5740-46bf-987e-5e3f43eca1c4 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:41:27.583740 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-6a57efed-5740-46bf-987e-5e3f43eca1c4 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: 446bb786-0ec7-4542-9509-36282d7126c8] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:41:27.592017 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-6a57efed-5740-46bf-987e-5e3f43eca1c4 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:41:27.592455 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-6a57efed-5740-46bf-987e-5e3f43eca1c4 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:41:27.593309 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-6a57efed-5740-46bf-987e-5e3f43eca1c4 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:41:27.593753 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-6a57efed-5740-46bf-987e-5e3f43eca1c4 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:41:27.750897 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-6a57efed-5740-46bf-987e-5e3f43eca1c4 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:41:27.762203 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-6a57efed-5740-46bf-987e-5e3f43eca1c4 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:41:27.763782 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-6a57efed-5740-46bf-987e-5e3f43eca1c4 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:41:27.765009 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-6a57efed-5740-46bf-987e-5e3f43eca1c4 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8" status: 200 len: 1724 microversion: 2.20 time: 0.186554 May 19 21:41:27.765576 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 402/817] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:41:27 2022] GET /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8 => generated 1724 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:41:28.784334 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-03e57880-0302-4a5b-b8c8-6e26d7ba2973 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:41:28.785418 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-03e57880-0302-4a5b-b8c8-6e26d7ba2973 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: 446bb786-0ec7-4542-9509-36282d7126c8] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:41:28.792227 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-03e57880-0302-4a5b-b8c8-6e26d7ba2973 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:41:28.792739 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-03e57880-0302-4a5b-b8c8-6e26d7ba2973 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:41:28.794208 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-03e57880-0302-4a5b-b8c8-6e26d7ba2973 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:41:28.794678 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-03e57880-0302-4a5b-b8c8-6e26d7ba2973 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:41:29.008352 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-03e57880-0302-4a5b-b8c8-6e26d7ba2973 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:41:29.018761 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-03e57880-0302-4a5b-b8c8-6e26d7ba2973 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:41:29.020766 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-03e57880-0302-4a5b-b8c8-6e26d7ba2973 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:41:29.022104 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-03e57880-0302-4a5b-b8c8-6e26d7ba2973 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8" status: 200 len: 1724 microversion: 2.20 time: 0.241861 May 19 21:41:29.023122 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 416/818] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:41:28 2022] GET /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8 => generated 1724 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:41:30.048903 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-d379b203-914c-4379-8830-059ca74ba676 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:41:30.049518 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-d379b203-914c-4379-8830-059ca74ba676 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: 446bb786-0ec7-4542-9509-36282d7126c8] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:41:30.056485 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-d379b203-914c-4379-8830-059ca74ba676 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:41:30.056925 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-d379b203-914c-4379-8830-059ca74ba676 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:41:30.057717 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-d379b203-914c-4379-8830-059ca74ba676 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:41:30.058837 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-d379b203-914c-4379-8830-059ca74ba676 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:41:30.243371 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-d379b203-914c-4379-8830-059ca74ba676 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:41:30.260566 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-d379b203-914c-4379-8830-059ca74ba676 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:41:30.262359 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-d379b203-914c-4379-8830-059ca74ba676 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:41:30.263614 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-d379b203-914c-4379-8830-059ca74ba676 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8" status: 200 len: 1724 microversion: 2.20 time: 0.218941 May 19 21:41:30.264456 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 403/819] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:41:30 2022] GET /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8 => generated 1724 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:41:31.284757 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-7eae21fd-3ae0-4192-a697-98f1ab766075 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:41:31.285453 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-7eae21fd-3ae0-4192-a697-98f1ab766075 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: 446bb786-0ec7-4542-9509-36282d7126c8] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:41:31.293953 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7eae21fd-3ae0-4192-a697-98f1ab766075 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:41:31.294487 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7eae21fd-3ae0-4192-a697-98f1ab766075 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:41:31.295435 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7eae21fd-3ae0-4192-a697-98f1ab766075 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:41:31.295921 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7eae21fd-3ae0-4192-a697-98f1ab766075 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:41:31.467682 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-7eae21fd-3ae0-4192-a697-98f1ab766075 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:41:31.476223 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-7eae21fd-3ae0-4192-a697-98f1ab766075 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:41:31.477716 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-7eae21fd-3ae0-4192-a697-98f1ab766075 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:41:31.478929 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-7eae21fd-3ae0-4192-a697-98f1ab766075 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8" status: 200 len: 1724 microversion: 2.20 time: 0.199728 May 19 21:41:31.479486 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 417/820] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:41:31 2022] GET /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8 => generated 1724 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 21:41:32.497384 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-dff9e2ca-8402-4ad1-ba3a-8fd44955135d tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:41:32.498098 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-dff9e2ca-8402-4ad1-ba3a-8fd44955135d tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: 446bb786-0ec7-4542-9509-36282d7126c8] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:41:32.505479 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-dff9e2ca-8402-4ad1-ba3a-8fd44955135d tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:41:32.505936 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-dff9e2ca-8402-4ad1-ba3a-8fd44955135d tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:41:32.506778 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-dff9e2ca-8402-4ad1-ba3a-8fd44955135d tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:41:32.507442 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-dff9e2ca-8402-4ad1-ba3a-8fd44955135d tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:41:32.652558 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-dff9e2ca-8402-4ad1-ba3a-8fd44955135d tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:41:32.661820 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-dff9e2ca-8402-4ad1-ba3a-8fd44955135d tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:41:32.663432 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-dff9e2ca-8402-4ad1-ba3a-8fd44955135d tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:41:32.664664 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-dff9e2ca-8402-4ad1-ba3a-8fd44955135d tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8" status: 200 len: 1724 microversion: 2.20 time: 0.171482 May 19 21:41:32.665222 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 404/821] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:41:32 2022] GET /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8 => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:41:33.685955 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-1487a2e9-1238-4f8e-9eb4-1152e2944969 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:41:33.686690 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-1487a2e9-1238-4f8e-9eb4-1152e2944969 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: 446bb786-0ec7-4542-9509-36282d7126c8] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:41:33.695030 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1487a2e9-1238-4f8e-9eb4-1152e2944969 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:41:33.695482 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1487a2e9-1238-4f8e-9eb4-1152e2944969 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:41:33.696357 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1487a2e9-1238-4f8e-9eb4-1152e2944969 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:41:33.696788 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1487a2e9-1238-4f8e-9eb4-1152e2944969 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:41:33.836169 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-1487a2e9-1238-4f8e-9eb4-1152e2944969 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:41:33.845599 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-1487a2e9-1238-4f8e-9eb4-1152e2944969 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:41:33.847185 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-1487a2e9-1238-4f8e-9eb4-1152e2944969 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:41:33.848300 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-1487a2e9-1238-4f8e-9eb4-1152e2944969 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8" status: 200 len: 1724 microversion: 2.20 time: 0.167857 May 19 21:41:33.849182 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 418/822] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:41:33 2022] GET /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8 => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:41:34.866995 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-508ad007-8d00-4438-a27f-64619482ad55 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:41:34.867626 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-508ad007-8d00-4438-a27f-64619482ad55 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: 446bb786-0ec7-4542-9509-36282d7126c8] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:41:34.874896 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-508ad007-8d00-4438-a27f-64619482ad55 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:41:34.875345 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-508ad007-8d00-4438-a27f-64619482ad55 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:41:34.876125 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-508ad007-8d00-4438-a27f-64619482ad55 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:41:34.876546 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-508ad007-8d00-4438-a27f-64619482ad55 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:41:35.034736 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-508ad007-8d00-4438-a27f-64619482ad55 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:41:35.044829 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-508ad007-8d00-4438-a27f-64619482ad55 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:41:35.046336 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-508ad007-8d00-4438-a27f-64619482ad55 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:41:35.047525 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-508ad007-8d00-4438-a27f-64619482ad55 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8" status: 200 len: 1724 microversion: 2.20 time: 0.184574 May 19 21:41:35.048071 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 405/823] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:41:34 2022] GET /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8 => generated 1724 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:41:36.066733 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-7beba0c3-0501-419e-9d9a-4fe91051b990 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:41:36.067350 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-7beba0c3-0501-419e-9d9a-4fe91051b990 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: 446bb786-0ec7-4542-9509-36282d7126c8] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:41:36.075797 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7beba0c3-0501-419e-9d9a-4fe91051b990 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:41:36.076240 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7beba0c3-0501-419e-9d9a-4fe91051b990 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:41:36.077088 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7beba0c3-0501-419e-9d9a-4fe91051b990 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:41:36.077500 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7beba0c3-0501-419e-9d9a-4fe91051b990 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:41:36.219224 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-7beba0c3-0501-419e-9d9a-4fe91051b990 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:41:36.228062 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-7beba0c3-0501-419e-9d9a-4fe91051b990 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:41:36.230070 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-7beba0c3-0501-419e-9d9a-4fe91051b990 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:41:36.231388 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-7beba0c3-0501-419e-9d9a-4fe91051b990 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8" status: 200 len: 1724 microversion: 2.20 time: 0.168755 May 19 21:41:36.232320 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 419/824] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:41:36 2022] GET /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8 => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:41:37.250717 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-9ca44f08-adca-4368-b26d-d2256b96d061 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:41:37.251364 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-9ca44f08-adca-4368-b26d-d2256b96d061 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: 446bb786-0ec7-4542-9509-36282d7126c8] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:41:37.258581 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-9ca44f08-adca-4368-b26d-d2256b96d061 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:41:37.259030 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-9ca44f08-adca-4368-b26d-d2256b96d061 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:41:37.259820 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-9ca44f08-adca-4368-b26d-d2256b96d061 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:41:37.260480 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-9ca44f08-adca-4368-b26d-d2256b96d061 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:41:37.446166 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-9ca44f08-adca-4368-b26d-d2256b96d061 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:41:37.455798 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-9ca44f08-adca-4368-b26d-d2256b96d061 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:41:37.457396 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-9ca44f08-adca-4368-b26d-d2256b96d061 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:41:37.458663 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-9ca44f08-adca-4368-b26d-d2256b96d061 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8" status: 200 len: 1724 microversion: 2.20 time: 0.212344 May 19 21:41:37.459232 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 406/825] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:41:37 2022] GET /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8 => generated 1724 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:41:38.478531 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-01f504bf-fcff-4835-a9dd-21f3fa252e9d tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:41:38.479182 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-01f504bf-fcff-4835-a9dd-21f3fa252e9d tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: 446bb786-0ec7-4542-9509-36282d7126c8] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:41:38.490716 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-01f504bf-fcff-4835-a9dd-21f3fa252e9d tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:41:38.491281 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-01f504bf-fcff-4835-a9dd-21f3fa252e9d tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:41:38.492047 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-01f504bf-fcff-4835-a9dd-21f3fa252e9d tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:41:38.492504 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-01f504bf-fcff-4835-a9dd-21f3fa252e9d tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:41:38.644138 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-01f504bf-fcff-4835-a9dd-21f3fa252e9d tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:41:38.652846 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-01f504bf-fcff-4835-a9dd-21f3fa252e9d tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:41:38.654387 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-01f504bf-fcff-4835-a9dd-21f3fa252e9d tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:41:38.655607 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-01f504bf-fcff-4835-a9dd-21f3fa252e9d tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8" status: 200 len: 1724 microversion: 2.20 time: 0.181255 May 19 21:41:38.656170 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 420/826] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:41:38 2022] GET /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8 => generated 1724 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:41:39.674794 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-aea7fe02-8492-417f-a0b1-70e21999ea0c tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:41:39.675306 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-aea7fe02-8492-417f-a0b1-70e21999ea0c tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: 446bb786-0ec7-4542-9509-36282d7126c8] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:41:39.682468 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-aea7fe02-8492-417f-a0b1-70e21999ea0c tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:41:39.682925 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-aea7fe02-8492-417f-a0b1-70e21999ea0c tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:41:39.683838 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-aea7fe02-8492-417f-a0b1-70e21999ea0c tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:41:39.684365 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-aea7fe02-8492-417f-a0b1-70e21999ea0c tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:41:39.833885 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-aea7fe02-8492-417f-a0b1-70e21999ea0c tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:41:39.844142 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-aea7fe02-8492-417f-a0b1-70e21999ea0c tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:41:39.845813 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-aea7fe02-8492-417f-a0b1-70e21999ea0c tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:41:39.847103 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-aea7fe02-8492-417f-a0b1-70e21999ea0c tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8" status: 200 len: 1745 microversion: 2.20 time: 0.176517 May 19 21:41:39.848038 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 407/827] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:41:39 2022] GET /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8 => generated 1745 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:41:40.867450 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-83241f05-775f-46f0-bfc1-3e4a5610b419 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:41:40.868090 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-83241f05-775f-46f0-bfc1-3e4a5610b419 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: 446bb786-0ec7-4542-9509-36282d7126c8] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:41:40.875502 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-83241f05-775f-46f0-bfc1-3e4a5610b419 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:41:40.875919 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-83241f05-775f-46f0-bfc1-3e4a5610b419 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:41:40.876742 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-83241f05-775f-46f0-bfc1-3e4a5610b419 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:41:40.877141 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-83241f05-775f-46f0-bfc1-3e4a5610b419 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:41:41.043931 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-83241f05-775f-46f0-bfc1-3e4a5610b419 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:41:41.052850 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-83241f05-775f-46f0-bfc1-3e4a5610b419 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:41:41.054481 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-83241f05-775f-46f0-bfc1-3e4a5610b419 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:41:41.055690 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-83241f05-775f-46f0-bfc1-3e4a5610b419 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8" status: 200 len: 1745 microversion: 2.20 time: 0.193183 May 19 21:41:41.067350 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 421/828] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:41:40 2022] GET /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8 => generated 1745 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:41:42.078345 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-c22a6ceb-e5d9-4088-b643-9edfa08ba6ba tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:41:42.078912 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-c22a6ceb-e5d9-4088-b643-9edfa08ba6ba tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: 446bb786-0ec7-4542-9509-36282d7126c8] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:41:42.089899 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c22a6ceb-e5d9-4088-b643-9edfa08ba6ba tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:41:42.090375 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c22a6ceb-e5d9-4088-b643-9edfa08ba6ba tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:41:42.091148 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c22a6ceb-e5d9-4088-b643-9edfa08ba6ba tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:41:42.091578 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c22a6ceb-e5d9-4088-b643-9edfa08ba6ba tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:41:42.252381 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-c22a6ceb-e5d9-4088-b643-9edfa08ba6ba tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:41:42.265348 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-c22a6ceb-e5d9-4088-b643-9edfa08ba6ba tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:41:42.266940 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-c22a6ceb-e5d9-4088-b643-9edfa08ba6ba tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:41:42.268104 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-c22a6ceb-e5d9-4088-b643-9edfa08ba6ba tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8" status: 200 len: 1745 microversion: 2.20 time: 0.196975 May 19 21:41:42.268671 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 408/829] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:41:42 2022] GET /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8 => generated 1745 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:41:42.997556 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [req-84c29f29-7578-4dcc-9922-2d9cd5c93418 req-cfb51572-ac5a-4e0a-a09b-da380f3bbf98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "446bb786-0ec7-4542-9509-36282d7126c8", "name": "network-vif-plugged", "status": "completed", "tag": "a93c27fd-fadb-4f8a-be75-eddb5e3c3921"}]} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:41:43.007820 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-84c29f29-7578-4dcc-9922-2d9cd5c93418 req-cfb51572-ac5a-4e0a-a09b-da380f3bbf98 service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:41:43.008382 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-84c29f29-7578-4dcc-9922-2d9cd5c93418 req-cfb51572-ac5a-4e0a-a09b-da380f3bbf98 service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:41:43.023304 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.compute.server_external_events [req-84c29f29-7578-4dcc-9922-2d9cd5c93418 req-cfb51572-ac5a-4e0a-a09b-da380f3bbf98 service nova] Creating event network-vif-plugged:a93c27fd-fadb-4f8a-be75-eddb5e3c3921 for instance 446bb786-0ec7-4542-9509-36282d7126c8 on hv-cinder-83563 May 19 21:41:43.032668 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [req-84c29f29-7578-4dcc-9922-2d9cd5c93418 req-cfb51572-ac5a-4e0a-a09b-da380f3bbf98 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038511 May 19 21:41:43.033578 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 422/830] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 21:41:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 21:41:43.287097 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-18b51968-d3a1-49e0-af74-0002d965f610 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:41:43.287683 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-18b51968-d3a1-49e0-af74-0002d965f610 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: 446bb786-0ec7-4542-9509-36282d7126c8] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:41:43.294883 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-18b51968-d3a1-49e0-af74-0002d965f610 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:41:43.295325 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-18b51968-d3a1-49e0-af74-0002d965f610 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:41:43.296099 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-18b51968-d3a1-49e0-af74-0002d965f610 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:41:43.296523 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-18b51968-d3a1-49e0-af74-0002d965f610 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:41:43.433344 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-18b51968-d3a1-49e0-af74-0002d965f610 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:41:43.441883 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-18b51968-d3a1-49e0-af74-0002d965f610 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:41:43.443381 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-18b51968-d3a1-49e0-af74-0002d965f610 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:41:43.444547 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-18b51968-d3a1-49e0-af74-0002d965f610 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8" status: 200 len: 1745 microversion: 2.20 time: 0.161568 May 19 21:41:43.445126 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 409/831] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:41:43 2022] GET /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8 => generated 1745 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:41:44.465786 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-3fc6a956-50fd-4cbb-86de-2a72f58020eb tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:41:44.467008 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-3fc6a956-50fd-4cbb-86de-2a72f58020eb tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: 446bb786-0ec7-4542-9509-36282d7126c8] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:41:44.473971 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3fc6a956-50fd-4cbb-86de-2a72f58020eb tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:41:44.474479 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3fc6a956-50fd-4cbb-86de-2a72f58020eb tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:41:44.475245 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3fc6a956-50fd-4cbb-86de-2a72f58020eb tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:41:44.475671 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3fc6a956-50fd-4cbb-86de-2a72f58020eb tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:41:44.636256 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-3fc6a956-50fd-4cbb-86de-2a72f58020eb tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:41:44.646657 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-3fc6a956-50fd-4cbb-86de-2a72f58020eb tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:41:44.648150 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-3fc6a956-50fd-4cbb-86de-2a72f58020eb tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:41:44.649344 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-3fc6a956-50fd-4cbb-86de-2a72f58020eb tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8" status: 200 len: 1745 microversion: 2.20 time: 0.189315 May 19 21:41:44.649905 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 423/832] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:41:44 2022] GET /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8 => generated 1745 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:41:45.672835 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-495ddbf1-0e14-4580-88c5-7980c2dd241c tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:41:45.673668 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-495ddbf1-0e14-4580-88c5-7980c2dd241c tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: 446bb786-0ec7-4542-9509-36282d7126c8] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:41:45.683347 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-495ddbf1-0e14-4580-88c5-7980c2dd241c tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:41:45.683789 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-495ddbf1-0e14-4580-88c5-7980c2dd241c tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:41:45.684559 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-495ddbf1-0e14-4580-88c5-7980c2dd241c tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:41:45.684976 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-495ddbf1-0e14-4580-88c5-7980c2dd241c tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:41:45.842475 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-495ddbf1-0e14-4580-88c5-7980c2dd241c tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:41:45.851727 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-495ddbf1-0e14-4580-88c5-7980c2dd241c tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:41:45.853364 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-495ddbf1-0e14-4580-88c5-7980c2dd241c tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:41:45.854723 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-495ddbf1-0e14-4580-88c5-7980c2dd241c tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8" status: 200 len: 1740 microversion: 2.20 time: 0.188457 May 19 21:41:45.855388 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 410/833] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:41:45 2022] GET /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8 => generated 1740 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:41:46.876128 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-16888fb9-839e-4c06-9912-56e799110288 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:41:46.877029 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-16888fb9-839e-4c06-9912-56e799110288 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: 446bb786-0ec7-4542-9509-36282d7126c8] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:41:46.883961 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-16888fb9-839e-4c06-9912-56e799110288 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:41:46.884616 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-16888fb9-839e-4c06-9912-56e799110288 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:41:46.885393 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-16888fb9-839e-4c06-9912-56e799110288 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:41:46.885800 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-16888fb9-839e-4c06-9912-56e799110288 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:41:47.082564 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-16888fb9-839e-4c06-9912-56e799110288 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:41:47.097728 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-16888fb9-839e-4c06-9912-56e799110288 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:41:47.099752 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-16888fb9-839e-4c06-9912-56e799110288 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:41:47.102526 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-16888fb9-839e-4c06-9912-56e799110288 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8" status: 200 len: 1740 microversion: 2.20 time: 0.230068 May 19 21:41:47.103853 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 424/834] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:41:46 2022] GET /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8 => generated 1740 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:41:48.127843 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-310ccb49-2f17-4ee6-bfd5-0e09857192c0 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:41:48.128630 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-310ccb49-2f17-4ee6-bfd5-0e09857192c0 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: 446bb786-0ec7-4542-9509-36282d7126c8] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:41:48.136544 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-310ccb49-2f17-4ee6-bfd5-0e09857192c0 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:41:48.137200 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-310ccb49-2f17-4ee6-bfd5-0e09857192c0 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:41:48.140244 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-310ccb49-2f17-4ee6-bfd5-0e09857192c0 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:41:48.141045 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-310ccb49-2f17-4ee6-bfd5-0e09857192c0 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:41:48.306788 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-310ccb49-2f17-4ee6-bfd5-0e09857192c0 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:41:48.317331 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-310ccb49-2f17-4ee6-bfd5-0e09857192c0 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:41:48.319402 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-310ccb49-2f17-4ee6-bfd5-0e09857192c0 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:41:48.320798 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-310ccb49-2f17-4ee6-bfd5-0e09857192c0 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8" status: 200 len: 1740 microversion: 2.20 time: 0.198536 May 19 21:41:48.321921 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 411/835] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:41:48 2022] GET /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8 => generated 1740 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:41:49.353793 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-a8ac479e-e1f7-4ff4-8d65-3bfd3f990594 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:41:49.355973 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-a8ac479e-e1f7-4ff4-8d65-3bfd3f990594 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: 446bb786-0ec7-4542-9509-36282d7126c8] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:41:49.369660 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a8ac479e-e1f7-4ff4-8d65-3bfd3f990594 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:41:49.371383 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a8ac479e-e1f7-4ff4-8d65-3bfd3f990594 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:41:49.373259 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a8ac479e-e1f7-4ff4-8d65-3bfd3f990594 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:41:49.374394 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a8ac479e-e1f7-4ff4-8d65-3bfd3f990594 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:41:49.641844 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-a8ac479e-e1f7-4ff4-8d65-3bfd3f990594 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:41:49.653767 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-a8ac479e-e1f7-4ff4-8d65-3bfd3f990594 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:41:49.654093 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-a8ac479e-e1f7-4ff4-8d65-3bfd3f990594 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:41:49.656038 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-a8ac479e-e1f7-4ff4-8d65-3bfd3f990594 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8" status: 200 len: 1740 microversion: 2.20 time: 0.314620 May 19 21:41:49.657328 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 425/836] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:41:49 2022] GET /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8 => generated 1740 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:41:50.679686 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-1a553b52-d8c3-4568-8b09-1e2cdaa63592 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:41:50.681311 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-1a553b52-d8c3-4568-8b09-1e2cdaa63592 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: 446bb786-0ec7-4542-9509-36282d7126c8] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:41:50.685351 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_api:SELECT=27 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:41:50.689326 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1a553b52-d8c3-4568-8b09-1e2cdaa63592 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:41:50.689849 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1a553b52-d8c3-4568-8b09-1e2cdaa63592 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:41:50.690786 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1a553b52-d8c3-4568-8b09-1e2cdaa63592 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:41:50.691455 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1a553b52-d8c3-4568-8b09-1e2cdaa63592 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:41:50.694896 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_cell1:SELECT=77 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:41:50.898764 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-1a553b52-d8c3-4568-8b09-1e2cdaa63592 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:41:50.913257 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-1a553b52-d8c3-4568-8b09-1e2cdaa63592 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:41:50.915286 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-1a553b52-d8c3-4568-8b09-1e2cdaa63592 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:41:50.919052 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-1a553b52-d8c3-4568-8b09-1e2cdaa63592 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8" status: 200 len: 1740 microversion: 2.20 time: 0.246743 May 19 21:41:50.930542 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 412/837] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:41:50 2022] GET /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8 => generated 1740 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:41:51.938005 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-3b8f6868-338f-4211-8b39-b56c54eb01d8 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:41:51.938786 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-3b8f6868-338f-4211-8b39-b56c54eb01d8 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: 446bb786-0ec7-4542-9509-36282d7126c8] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:41:51.948992 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3b8f6868-338f-4211-8b39-b56c54eb01d8 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:41:51.950051 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3b8f6868-338f-4211-8b39-b56c54eb01d8 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:41:51.951063 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3b8f6868-338f-4211-8b39-b56c54eb01d8 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:41:51.951517 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3b8f6868-338f-4211-8b39-b56c54eb01d8 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:41:52.133781 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-3b8f6868-338f-4211-8b39-b56c54eb01d8 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:41:52.147068 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-3b8f6868-338f-4211-8b39-b56c54eb01d8 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:41:52.148936 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-3b8f6868-338f-4211-8b39-b56c54eb01d8 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:41:52.150540 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-3b8f6868-338f-4211-8b39-b56c54eb01d8 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8" status: 200 len: 1740 microversion: 2.20 time: 0.216542 May 19 21:41:52.162069 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 426/838] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:41:51 2022] GET /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8 => generated 1740 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:41:53.175133 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-01c1a165-6ff6-41b0-9049-bc2ed8503f27 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:41:53.176086 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-01c1a165-6ff6-41b0-9049-bc2ed8503f27 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: 446bb786-0ec7-4542-9509-36282d7126c8] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:41:53.188947 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-01c1a165-6ff6-41b0-9049-bc2ed8503f27 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:41:53.189933 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-01c1a165-6ff6-41b0-9049-bc2ed8503f27 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:41:53.191909 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-01c1a165-6ff6-41b0-9049-bc2ed8503f27 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:41:53.192668 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-01c1a165-6ff6-41b0-9049-bc2ed8503f27 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:41:53.371706 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-01c1a165-6ff6-41b0-9049-bc2ed8503f27 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:41:53.381532 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-01c1a165-6ff6-41b0-9049-bc2ed8503f27 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:41:53.384791 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-01c1a165-6ff6-41b0-9049-bc2ed8503f27 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:41:53.386775 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-01c1a165-6ff6-41b0-9049-bc2ed8503f27 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8" status: 200 len: 1740 microversion: 2.20 time: 0.220195 May 19 21:41:53.387967 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 413/839] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:41:53 2022] GET /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8 => generated 1740 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:41:54.410150 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-276799bb-4f79-4413-8eda-764744fd3720 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:41:54.410594 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-276799bb-4f79-4413-8eda-764744fd3720 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: 446bb786-0ec7-4542-9509-36282d7126c8] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:41:54.413079 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_api:SELECT=29 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:41:54.419110 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-276799bb-4f79-4413-8eda-764744fd3720 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:41:54.419617 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-276799bb-4f79-4413-8eda-764744fd3720 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:41:54.420616 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-276799bb-4f79-4413-8eda-764744fd3720 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:41:54.421079 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-276799bb-4f79-4413-8eda-764744fd3720 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:41:54.424613 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:41:54.603122 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-276799bb-4f79-4413-8eda-764744fd3720 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:41:54.612490 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-276799bb-4f79-4413-8eda-764744fd3720 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:41:54.614009 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-276799bb-4f79-4413-8eda-764744fd3720 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:41:54.615300 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-276799bb-4f79-4413-8eda-764744fd3720 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8" status: 200 len: 1740 microversion: 2.20 time: 0.209683 May 19 21:41:54.615878 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 427/840] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:41:54 2022] GET /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8 => generated 1740 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 21:41:55.637427 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-6d416960-88df-4db8-b991-9db26646b42b tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:41:55.638688 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-6d416960-88df-4db8-b991-9db26646b42b tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: 446bb786-0ec7-4542-9509-36282d7126c8] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:41:55.649533 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-6d416960-88df-4db8-b991-9db26646b42b tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:41:55.650158 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-6d416960-88df-4db8-b991-9db26646b42b tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:41:55.651143 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-6d416960-88df-4db8-b991-9db26646b42b tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:41:55.652028 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-6d416960-88df-4db8-b991-9db26646b42b tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:41:55.804734 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-6d416960-88df-4db8-b991-9db26646b42b tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:41:55.819608 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-6d416960-88df-4db8-b991-9db26646b42b tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:41:55.822183 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-6d416960-88df-4db8-b991-9db26646b42b tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:41:55.824424 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-6d416960-88df-4db8-b991-9db26646b42b tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8" status: 200 len: 1740 microversion: 2.20 time: 0.193534 May 19 21:41:55.838156 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 414/841] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:41:55 2022] GET /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8 => generated 1740 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:41:56.846213 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-dde770d0-eb16-4c66-a251-ab4a240c3501 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:41:56.846862 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-dde770d0-eb16-4c66-a251-ab4a240c3501 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: 446bb786-0ec7-4542-9509-36282d7126c8] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:41:56.853525 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-dde770d0-eb16-4c66-a251-ab4a240c3501 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:41:56.853970 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-dde770d0-eb16-4c66-a251-ab4a240c3501 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:41:56.855263 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-dde770d0-eb16-4c66-a251-ab4a240c3501 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:41:56.855263 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-dde770d0-eb16-4c66-a251-ab4a240c3501 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:41:56.993615 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-dde770d0-eb16-4c66-a251-ab4a240c3501 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:41:57.002194 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-dde770d0-eb16-4c66-a251-ab4a240c3501 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:41:57.003712 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-dde770d0-eb16-4c66-a251-ab4a240c3501 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:41:57.005068 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-dde770d0-eb16-4c66-a251-ab4a240c3501 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8" status: 200 len: 1740 microversion: 2.20 time: 0.162985 May 19 21:41:57.005812 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 428/842] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:41:56 2022] GET /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8 => generated 1740 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:41:58.024150 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-b0833ee4-b040-49b7-a679-cd5919e5bfee tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:41:58.024801 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-b0833ee4-b040-49b7-a679-cd5919e5bfee tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: 446bb786-0ec7-4542-9509-36282d7126c8] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:41:58.032130 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-b0833ee4-b040-49b7-a679-cd5919e5bfee tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:41:58.032582 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-b0833ee4-b040-49b7-a679-cd5919e5bfee tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:41:58.033365 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-b0833ee4-b040-49b7-a679-cd5919e5bfee tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:41:58.034692 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-b0833ee4-b040-49b7-a679-cd5919e5bfee tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:41:58.186789 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-b0833ee4-b040-49b7-a679-cd5919e5bfee tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:41:58.199283 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-b0833ee4-b040-49b7-a679-cd5919e5bfee tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:41:58.201334 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-b0833ee4-b040-49b7-a679-cd5919e5bfee tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:41:58.202511 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-b0833ee4-b040-49b7-a679-cd5919e5bfee tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8" status: 200 len: 1722 microversion: 2.20 time: 0.182381 May 19 21:41:58.203065 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 415/843] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:41:58 2022] GET /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8 => generated 1722 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:41:59.221814 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-64526ee1-a77f-43e4-a100-f7799bf2a899 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:41:59.222421 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-64526ee1-a77f-43e4-a100-f7799bf2a899 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: 446bb786-0ec7-4542-9509-36282d7126c8] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:41:59.229415 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-64526ee1-a77f-43e4-a100-f7799bf2a899 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:41:59.229853 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-64526ee1-a77f-43e4-a100-f7799bf2a899 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:41:59.235100 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-64526ee1-a77f-43e4-a100-f7799bf2a899 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:41:59.235644 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-64526ee1-a77f-43e4-a100-f7799bf2a899 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:41:59.376090 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-64526ee1-a77f-43e4-a100-f7799bf2a899 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:41:59.384589 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-64526ee1-a77f-43e4-a100-f7799bf2a899 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:41:59.386057 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-64526ee1-a77f-43e4-a100-f7799bf2a899 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:41:59.387439 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-64526ee1-a77f-43e4-a100-f7799bf2a899 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8" status: 200 len: 1722 microversion: 2.20 time: 0.169559 May 19 21:41:59.388182 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 429/844] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:41:59 2022] GET /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8 => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:42:00.407194 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-b230f765-b5ca-46f9-85ee-e18169cb4378 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:42:00.407872 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-b230f765-b5ca-46f9-85ee-e18169cb4378 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: 446bb786-0ec7-4542-9509-36282d7126c8] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:42:00.414969 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-b230f765-b5ca-46f9-85ee-e18169cb4378 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:42:00.415411 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-b230f765-b5ca-46f9-85ee-e18169cb4378 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:42:00.416168 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-b230f765-b5ca-46f9-85ee-e18169cb4378 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:42:00.416596 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-b230f765-b5ca-46f9-85ee-e18169cb4378 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:42:00.563352 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-b230f765-b5ca-46f9-85ee-e18169cb4378 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:42:00.571943 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-b230f765-b5ca-46f9-85ee-e18169cb4378 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:42:00.573428 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-b230f765-b5ca-46f9-85ee-e18169cb4378 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:42:00.575265 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-b230f765-b5ca-46f9-85ee-e18169cb4378 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8" status: 200 len: 1722 microversion: 2.20 time: 0.171442 May 19 21:42:00.575829 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 416/845] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:42:00 2022] GET /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8 => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:42:00.992253 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [req-d096812a-cd52-461b-afa1-3f79f6ec66cc req-ce1129ab-cd2d-4e93-b2d8-e18e148db7c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "446bb786-0ec7-4542-9509-36282d7126c8", "name": "network-vif-unplugged", "status": "completed", "tag": "a93c27fd-fadb-4f8a-be75-eddb5e3c3921"}]} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:42:01.002908 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-d096812a-cd52-461b-afa1-3f79f6ec66cc req-ce1129ab-cd2d-4e93-b2d8-e18e148db7c8 service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:42:01.004680 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-d096812a-cd52-461b-afa1-3f79f6ec66cc req-ce1129ab-cd2d-4e93-b2d8-e18e148db7c8 service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:42:01.018972 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.compute.server_external_events [req-d096812a-cd52-461b-afa1-3f79f6ec66cc req-ce1129ab-cd2d-4e93-b2d8-e18e148db7c8 service nova] Creating event network-vif-unplugged:a93c27fd-fadb-4f8a-be75-eddb5e3c3921 for instance 446bb786-0ec7-4542-9509-36282d7126c8 on hv-cinder-83563 May 19 21:42:01.024269 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [req-d096812a-cd52-461b-afa1-3f79f6ec66cc req-ce1129ab-cd2d-4e93-b2d8-e18e148db7c8 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036328 May 19 21:42:01.025027 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 430/846] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 21:42:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 21:42:01.595678 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-4a1d2b9b-ab30-4db8-9e72-482dac0f728c tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:42:01.596326 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-4a1d2b9b-ab30-4db8-9e72-482dac0f728c tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: 446bb786-0ec7-4542-9509-36282d7126c8] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:42:01.606013 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-4a1d2b9b-ab30-4db8-9e72-482dac0f728c tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:42:01.606934 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-4a1d2b9b-ab30-4db8-9e72-482dac0f728c tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:42:01.607757 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-4a1d2b9b-ab30-4db8-9e72-482dac0f728c tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:42:01.608412 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-4a1d2b9b-ab30-4db8-9e72-482dac0f728c tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:42:01.752403 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-4a1d2b9b-ab30-4db8-9e72-482dac0f728c tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:42:01.761952 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-4a1d2b9b-ab30-4db8-9e72-482dac0f728c tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:42:01.764409 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-4a1d2b9b-ab30-4db8-9e72-482dac0f728c tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:42:01.765657 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-4a1d2b9b-ab30-4db8-9e72-482dac0f728c tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8" status: 200 len: 1722 microversion: 2.20 time: 0.175546 May 19 21:42:01.766218 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 417/847] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:42:01 2022] GET /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8 => generated 1722 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:42:02.787516 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-2c7fbf04-def1-4451-a9dd-b9f2375358a9 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:42:02.788168 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-2c7fbf04-def1-4451-a9dd-b9f2375358a9 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: 446bb786-0ec7-4542-9509-36282d7126c8] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:42:02.795668 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2c7fbf04-def1-4451-a9dd-b9f2375358a9 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:42:02.796118 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2c7fbf04-def1-4451-a9dd-b9f2375358a9 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:42:02.796886 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2c7fbf04-def1-4451-a9dd-b9f2375358a9 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:42:02.797322 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2c7fbf04-def1-4451-a9dd-b9f2375358a9 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:42:02.938034 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-2c7fbf04-def1-4451-a9dd-b9f2375358a9 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:42:02.946549 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-2c7fbf04-def1-4451-a9dd-b9f2375358a9 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:42:02.948044 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-2c7fbf04-def1-4451-a9dd-b9f2375358a9 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:42:02.949210 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-2c7fbf04-def1-4451-a9dd-b9f2375358a9 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8" status: 200 len: 1665 microversion: 2.20 time: 0.166157 May 19 21:42:02.950215 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 431/848] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:42:02 2022] GET /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8 => generated 1665 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:42:02.968063 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-5c07cc5f-7094-491d-b3b0-11cf83ba6184 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4ace22f5-88fa-4556-b70c-abf870a4d7c9"}} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:42:02.969159 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-5c07cc5f-7094-491d-b3b0-11cf83ba6184 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: 446bb786-0ec7-4542-9509-36282d7126c8] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:42:02.976248 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-5c07cc5f-7094-491d-b3b0-11cf83ba6184 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:42:02.976719 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-5c07cc5f-7094-491d-b3b0-11cf83ba6184 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:42:02.977514 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-5c07cc5f-7094-491d-b3b0-11cf83ba6184 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:42:02.977947 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-5c07cc5f-7094-491d-b3b0-11cf83ba6184 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:42:03.287062 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-5c07cc5f-7094-491d-b3b0-11cf83ba6184 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "POST /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.322810 May 19 21:42:03.287927 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 418/849] 10.222.0.65 () {62 vars in 1363 bytes} [Thu May 19 21:42:02 2022] POST /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8/os-volume_attachments => generated 188 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 21:42:03.417825 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-a5cc26fb-16d2-4001-ab59-4a83810c21ca tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:42:03.418340 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-a5cc26fb-16d2-4001-ab59-4a83810c21ca tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: 446bb786-0ec7-4542-9509-36282d7126c8] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:42:03.425250 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a5cc26fb-16d2-4001-ab59-4a83810c21ca tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:42:03.425689 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a5cc26fb-16d2-4001-ab59-4a83810c21ca tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:42:03.426593 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a5cc26fb-16d2-4001-ab59-4a83810c21ca tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:42:03.427045 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a5cc26fb-16d2-4001-ab59-4a83810c21ca tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:42:03.686339 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-a5cc26fb-16d2-4001-ab59-4a83810c21ca tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "DELETE /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8/os-volume_attachments/4ace22f5-88fa-4556-b70c-abf870a4d7c9" status: 202 len: 0 microversion: 2.20 time: 0.272405 May 19 21:42:03.686901 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 432/850] 10.222.0.65 () {60 vars in 1456 bytes} [Thu May 19 21:42:03 2022] DELETE /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8/os-volume_attachments/4ace22f5-88fa-4556-b70c-abf870a4d7c9 => generated 0 bytes in 274 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 19 21:42:03.748764 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-4a5ccf7a-f5c9-4661-ae7f-dca06e712d91 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:42:03.749321 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-4a5ccf7a-f5c9-4661-ae7f-dca06e712d91 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: 446bb786-0ec7-4542-9509-36282d7126c8] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:42:03.756714 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-4a5ccf7a-f5c9-4661-ae7f-dca06e712d91 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:42:03.757286 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-4a5ccf7a-f5c9-4661-ae7f-dca06e712d91 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:42:03.757952 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-4a5ccf7a-f5c9-4661-ae7f-dca06e712d91 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:42:03.758444 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-4a5ccf7a-f5c9-4661-ae7f-dca06e712d91 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:42:03.877029 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-4a5ccf7a-f5c9-4661-ae7f-dca06e712d91 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "POST /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8/action" status: 202 len: 0 microversion: 2.20 time: 0.132639 May 19 21:42:03.877650 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 419/851] 10.222.0.65 () {62 vars in 1318 bytes} [Thu May 19 21:42:03 2022] POST /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8/action => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 19 21:42:03.886232 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-d1b372ed-5d38-4646-be10-fb68dbb7fb61 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:42:03.887033 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-d1b372ed-5d38-4646-be10-fb68dbb7fb61 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: 446bb786-0ec7-4542-9509-36282d7126c8] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:42:03.895167 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d1b372ed-5d38-4646-be10-fb68dbb7fb61 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:42:03.895610 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d1b372ed-5d38-4646-be10-fb68dbb7fb61 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:42:03.896373 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d1b372ed-5d38-4646-be10-fb68dbb7fb61 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:42:03.896798 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d1b372ed-5d38-4646-be10-fb68dbb7fb61 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:42:04.041562 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-d1b372ed-5d38-4646-be10-fb68dbb7fb61 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:42:04.051331 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-d1b372ed-5d38-4646-be10-fb68dbb7fb61 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:42:04.052911 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-d1b372ed-5d38-4646-be10-fb68dbb7fb61 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:42:04.054179 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-d1b372ed-5d38-4646-be10-fb68dbb7fb61 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8" status: 200 len: 1673 microversion: 2.20 time: 0.172128 May 19 21:42:04.054833 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 433/852] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:42:03 2022] GET /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8 => generated 1673 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:42:05.075111 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-63d09fe7-1dfd-4c6b-8df3-094e48b9dfa0 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:42:05.075732 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-63d09fe7-1dfd-4c6b-8df3-094e48b9dfa0 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: 446bb786-0ec7-4542-9509-36282d7126c8] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:42:05.082083 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-63d09fe7-1dfd-4c6b-8df3-094e48b9dfa0 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:42:05.082576 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-63d09fe7-1dfd-4c6b-8df3-094e48b9dfa0 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:42:05.083347 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-63d09fe7-1dfd-4c6b-8df3-094e48b9dfa0 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:42:05.083775 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-63d09fe7-1dfd-4c6b-8df3-094e48b9dfa0 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:42:05.225118 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-63d09fe7-1dfd-4c6b-8df3-094e48b9dfa0 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:42:05.234276 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-63d09fe7-1dfd-4c6b-8df3-094e48b9dfa0 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:42:05.235818 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-63d09fe7-1dfd-4c6b-8df3-094e48b9dfa0 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:42:05.236998 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-63d09fe7-1dfd-4c6b-8df3-094e48b9dfa0 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8" status: 200 len: 1675 microversion: 2.20 time: 0.166965 May 19 21:42:05.237558 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 420/853] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:42:05 2022] GET /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8 => generated 1675 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:42:06.256817 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-8796dd19-d061-4d87-a46a-5d40c2350402 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:42:06.257443 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-8796dd19-d061-4d87-a46a-5d40c2350402 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: 446bb786-0ec7-4542-9509-36282d7126c8] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:42:06.264936 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8796dd19-d061-4d87-a46a-5d40c2350402 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:42:06.265374 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8796dd19-d061-4d87-a46a-5d40c2350402 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:42:06.266122 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8796dd19-d061-4d87-a46a-5d40c2350402 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:42:06.266576 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8796dd19-d061-4d87-a46a-5d40c2350402 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:42:06.408813 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-8796dd19-d061-4d87-a46a-5d40c2350402 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:42:06.418001 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-8796dd19-d061-4d87-a46a-5d40c2350402 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:42:06.419723 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-8796dd19-d061-4d87-a46a-5d40c2350402 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:42:06.422061 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-8796dd19-d061-4d87-a46a-5d40c2350402 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8" status: 200 len: 1731 microversion: 2.20 time: 0.169362 May 19 21:42:06.432909 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 434/854] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:42:06 2022] GET /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8 => generated 1731 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:42:07.441584 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-1acc140e-9e05-4645-be93-4ce701c1bac9 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:42:07.442224 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-1acc140e-9e05-4645-be93-4ce701c1bac9 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: 446bb786-0ec7-4542-9509-36282d7126c8] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:42:07.451338 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1acc140e-9e05-4645-be93-4ce701c1bac9 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:42:07.451685 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1acc140e-9e05-4645-be93-4ce701c1bac9 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:42:07.452640 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1acc140e-9e05-4645-be93-4ce701c1bac9 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:42:07.453208 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1acc140e-9e05-4645-be93-4ce701c1bac9 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:42:07.612379 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-1acc140e-9e05-4645-be93-4ce701c1bac9 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:42:07.620920 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-1acc140e-9e05-4645-be93-4ce701c1bac9 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:42:07.622537 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-1acc140e-9e05-4645-be93-4ce701c1bac9 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:42:07.623714 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-1acc140e-9e05-4645-be93-4ce701c1bac9 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8" status: 200 len: 1731 microversion: 2.20 time: 0.186282 May 19 21:42:07.624299 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 421/855] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:42:07 2022] GET /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8 => generated 1731 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:42:08.645267 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-e274b21e-a869-4a03-becd-bdf214288e31 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:42:08.645857 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-e274b21e-a869-4a03-becd-bdf214288e31 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: 446bb786-0ec7-4542-9509-36282d7126c8] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:42:08.654649 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e274b21e-a869-4a03-becd-bdf214288e31 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:42:08.655275 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e274b21e-a869-4a03-becd-bdf214288e31 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:42:08.656357 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e274b21e-a869-4a03-becd-bdf214288e31 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:42:08.656947 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e274b21e-a869-4a03-becd-bdf214288e31 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:42:08.802418 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-e274b21e-a869-4a03-becd-bdf214288e31 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:42:08.811086 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-e274b21e-a869-4a03-becd-bdf214288e31 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:42:08.812589 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-e274b21e-a869-4a03-becd-bdf214288e31 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:42:08.813750 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-e274b21e-a869-4a03-becd-bdf214288e31 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8" status: 200 len: 1731 microversion: 2.20 time: 0.174701 May 19 21:42:08.814389 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 435/856] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:42:08 2022] GET /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8 => generated 1731 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:42:09.842553 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-fcd7dbf1-5ed6-4448-87db-495187df260a tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:42:09.843194 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-fcd7dbf1-5ed6-4448-87db-495187df260a tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: 446bb786-0ec7-4542-9509-36282d7126c8] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:42:09.852182 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-fcd7dbf1-5ed6-4448-87db-495187df260a tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:42:09.852631 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-fcd7dbf1-5ed6-4448-87db-495187df260a tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:42:09.853420 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-fcd7dbf1-5ed6-4448-87db-495187df260a tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:42:09.853827 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-fcd7dbf1-5ed6-4448-87db-495187df260a tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:42:10.006048 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-fcd7dbf1-5ed6-4448-87db-495187df260a tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:42:10.015063 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-fcd7dbf1-5ed6-4448-87db-495187df260a tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:42:10.017604 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-fcd7dbf1-5ed6-4448-87db-495187df260a tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:42:10.019046 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-fcd7dbf1-5ed6-4448-87db-495187df260a tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8" status: 200 len: 1731 microversion: 2.20 time: 0.182453 May 19 21:42:10.030473 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 422/857] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:42:09 2022] GET /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8 => generated 1731 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:42:11.038938 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-aeabc285-96bb-4f03-8de2-f17367caa5e7 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:42:11.039862 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-aeabc285-96bb-4f03-8de2-f17367caa5e7 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: 446bb786-0ec7-4542-9509-36282d7126c8] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:42:11.048317 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-aeabc285-96bb-4f03-8de2-f17367caa5e7 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:42:11.048782 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-aeabc285-96bb-4f03-8de2-f17367caa5e7 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:42:11.049586 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-aeabc285-96bb-4f03-8de2-f17367caa5e7 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:42:11.050011 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-aeabc285-96bb-4f03-8de2-f17367caa5e7 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:42:11.205982 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-aeabc285-96bb-4f03-8de2-f17367caa5e7 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:42:11.214835 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-aeabc285-96bb-4f03-8de2-f17367caa5e7 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:42:11.216471 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-aeabc285-96bb-4f03-8de2-f17367caa5e7 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:42:11.217649 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-aeabc285-96bb-4f03-8de2-f17367caa5e7 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8" status: 200 len: 1731 microversion: 2.20 time: 0.184015 May 19 21:42:11.218261 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 436/858] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:42:11 2022] GET /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8 => generated 1731 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:42:12.238021 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-1afbaedc-3584-4602-9b45-db1797b00d2c tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:42:12.238656 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-1afbaedc-3584-4602-9b45-db1797b00d2c tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: 446bb786-0ec7-4542-9509-36282d7126c8] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:42:12.247407 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1afbaedc-3584-4602-9b45-db1797b00d2c tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:42:12.248200 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1afbaedc-3584-4602-9b45-db1797b00d2c tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:42:12.249517 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1afbaedc-3584-4602-9b45-db1797b00d2c tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:42:12.250373 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1afbaedc-3584-4602-9b45-db1797b00d2c tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:42:12.476478 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-1afbaedc-3584-4602-9b45-db1797b00d2c tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:42:12.485018 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-1afbaedc-3584-4602-9b45-db1797b00d2c tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:42:12.486546 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-1afbaedc-3584-4602-9b45-db1797b00d2c tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:42:12.487731 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-1afbaedc-3584-4602-9b45-db1797b00d2c tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8" status: 200 len: 1731 microversion: 2.20 time: 0.254272 May 19 21:42:12.488275 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 423/859] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:42:12 2022] GET /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8 => generated 1731 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:42:13.508171 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-a163f32e-d43f-440a-be05-4a3cd27b53bf tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:42:13.508171 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-a163f32e-d43f-440a-be05-4a3cd27b53bf tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: 446bb786-0ec7-4542-9509-36282d7126c8] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:42:13.514717 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a163f32e-d43f-440a-be05-4a3cd27b53bf tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:42:13.515091 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a163f32e-d43f-440a-be05-4a3cd27b53bf tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:42:13.515860 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a163f32e-d43f-440a-be05-4a3cd27b53bf tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:42:13.516282 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a163f32e-d43f-440a-be05-4a3cd27b53bf tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:42:13.724943 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-a163f32e-d43f-440a-be05-4a3cd27b53bf tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:42:13.744608 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-a163f32e-d43f-440a-be05-4a3cd27b53bf tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:42:13.746103 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-a163f32e-d43f-440a-be05-4a3cd27b53bf tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:42:13.747327 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-a163f32e-d43f-440a-be05-4a3cd27b53bf tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8" status: 200 len: 1731 microversion: 2.20 time: 0.245018 May 19 21:42:13.747901 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 437/860] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:42:13 2022] GET /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8 => generated 1731 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:42:14.767764 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-ebe9aae0-3e06-44f6-97d2-a80bc851a1f9 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:42:14.768702 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-ebe9aae0-3e06-44f6-97d2-a80bc851a1f9 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: 446bb786-0ec7-4542-9509-36282d7126c8] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:42:14.780181 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ebe9aae0-3e06-44f6-97d2-a80bc851a1f9 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:42:14.780800 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ebe9aae0-3e06-44f6-97d2-a80bc851a1f9 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:42:14.781678 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ebe9aae0-3e06-44f6-97d2-a80bc851a1f9 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:42:14.782175 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ebe9aae0-3e06-44f6-97d2-a80bc851a1f9 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:42:14.927688 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-ebe9aae0-3e06-44f6-97d2-a80bc851a1f9 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:42:14.936067 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-ebe9aae0-3e06-44f6-97d2-a80bc851a1f9 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:42:14.938141 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-ebe9aae0-3e06-44f6-97d2-a80bc851a1f9 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:42:14.939326 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-ebe9aae0-3e06-44f6-97d2-a80bc851a1f9 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8" status: 200 len: 1731 microversion: 2.20 time: 0.176598 May 19 21:42:14.939960 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 424/861] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:42:14 2022] GET /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8 => generated 1731 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:42:15.958491 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-46358ee3-42fe-423d-91a8-656a46e90750 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:42:15.959179 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-46358ee3-42fe-423d-91a8-656a46e90750 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: 446bb786-0ec7-4542-9509-36282d7126c8] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:42:15.966021 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-46358ee3-42fe-423d-91a8-656a46e90750 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:42:15.966483 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-46358ee3-42fe-423d-91a8-656a46e90750 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:42:15.967434 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-46358ee3-42fe-423d-91a8-656a46e90750 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:42:15.967880 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-46358ee3-42fe-423d-91a8-656a46e90750 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:42:16.149212 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-46358ee3-42fe-423d-91a8-656a46e90750 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:42:16.159439 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-46358ee3-42fe-423d-91a8-656a46e90750 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:42:16.161550 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-46358ee3-42fe-423d-91a8-656a46e90750 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:42:16.163830 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-46358ee3-42fe-423d-91a8-656a46e90750 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8" status: 200 len: 1731 microversion: 2.20 time: 0.209326 May 19 21:42:16.164596 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 438/862] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:42:15 2022] GET /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8 => generated 1731 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:42:17.184055 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-d68cdbd6-47e2-467f-a858-a18d3fe48ab2 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:42:17.184841 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-d68cdbd6-47e2-467f-a858-a18d3fe48ab2 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: 446bb786-0ec7-4542-9509-36282d7126c8] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:42:17.191539 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-d68cdbd6-47e2-467f-a858-a18d3fe48ab2 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:42:17.191993 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-d68cdbd6-47e2-467f-a858-a18d3fe48ab2 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:42:17.192774 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-d68cdbd6-47e2-467f-a858-a18d3fe48ab2 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:42:17.193201 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-d68cdbd6-47e2-467f-a858-a18d3fe48ab2 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:42:17.195852 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:42:17.347948 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-d68cdbd6-47e2-467f-a858-a18d3fe48ab2 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:42:17.356394 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-d68cdbd6-47e2-467f-a858-a18d3fe48ab2 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:42:17.358330 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-d68cdbd6-47e2-467f-a858-a18d3fe48ab2 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:42:17.359978 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-d68cdbd6-47e2-467f-a858-a18d3fe48ab2 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8" status: 200 len: 1731 microversion: 2.20 time: 0.179770 May 19 21:42:17.360607 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 425/863] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:42:17 2022] GET /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8 => generated 1731 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:42:18.380928 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-7d6f3bdc-82ae-42ec-aafa-c7d21d7b6e2c tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:42:18.381544 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-7d6f3bdc-82ae-42ec-aafa-c7d21d7b6e2c tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: 446bb786-0ec7-4542-9509-36282d7126c8] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:42:18.391309 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7d6f3bdc-82ae-42ec-aafa-c7d21d7b6e2c tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:42:18.391949 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7d6f3bdc-82ae-42ec-aafa-c7d21d7b6e2c tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:42:18.393171 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7d6f3bdc-82ae-42ec-aafa-c7d21d7b6e2c tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:42:18.393822 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7d6f3bdc-82ae-42ec-aafa-c7d21d7b6e2c tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:42:18.546332 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-7d6f3bdc-82ae-42ec-aafa-c7d21d7b6e2c tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:42:18.555298 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-7d6f3bdc-82ae-42ec-aafa-c7d21d7b6e2c tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:42:18.556789 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-7d6f3bdc-82ae-42ec-aafa-c7d21d7b6e2c tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:42:18.558162 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-7d6f3bdc-82ae-42ec-aafa-c7d21d7b6e2c tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8" status: 200 len: 1731 microversion: 2.20 time: 0.181481 May 19 21:42:18.558910 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 439/864] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:42:18 2022] GET /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8 => generated 1731 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:42:19.577659 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-4b374030-c28b-49f4-a10f-c0c1971fe5ec tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:42:19.578348 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-4b374030-c28b-49f4-a10f-c0c1971fe5ec tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: 446bb786-0ec7-4542-9509-36282d7126c8] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:42:19.585219 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-4b374030-c28b-49f4-a10f-c0c1971fe5ec tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:42:19.585671 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-4b374030-c28b-49f4-a10f-c0c1971fe5ec tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:42:19.586487 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-4b374030-c28b-49f4-a10f-c0c1971fe5ec tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:42:19.586925 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-4b374030-c28b-49f4-a10f-c0c1971fe5ec tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:42:19.731148 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-4b374030-c28b-49f4-a10f-c0c1971fe5ec tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:42:19.742922 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-4b374030-c28b-49f4-a10f-c0c1971fe5ec tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:42:19.745522 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-4b374030-c28b-49f4-a10f-c0c1971fe5ec tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:42:19.747396 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-4b374030-c28b-49f4-a10f-c0c1971fe5ec tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8" status: 200 len: 1731 microversion: 2.20 time: 0.174006 May 19 21:42:19.748236 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 426/865] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:42:19 2022] GET /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8 => generated 1731 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:42:20.147408 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-667a5c39-46f9-4d6b-87b7-855d8fc8e5a5 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1196478296", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2053369052", "security_groups": [{"name": "tempest-secgroup-smoke-1388373731"}], "block_device_mapping_v2": [{"uuid": "8a78f114-0bf3-4dee-a14c-19779ee339a5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "d5d9547d-2306-4c78-9ac6-532192256ea5"}]}} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:42:20.301979 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.network.neutron [None req-667a5c39-46f9-4d6b-87b7-855d8fc8e5a5 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] validate_networks() for [('d5d9547d-2306-4c78-9ac6-532192256ea5', None, None, None, None, None)] {{(pid=124350) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 19 21:42:20.768141 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-8d996b52-8fc6-4988-9600-a3304f95278d tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:42:20.768815 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-8d996b52-8fc6-4988-9600-a3304f95278d tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: 446bb786-0ec7-4542-9509-36282d7126c8] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:42:20.771245 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_api:SELECT=32 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:42:20.781923 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-8d996b52-8fc6-4988-9600-a3304f95278d tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:42:20.782891 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-8d996b52-8fc6-4988-9600-a3304f95278d tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:42:20.787429 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-8d996b52-8fc6-4988-9600-a3304f95278d tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:42:20.788201 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-8d996b52-8fc6-4988-9600-a3304f95278d tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:42:20.886321 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.virt.hardware [None req-667a5c39-46f9-4d6b-87b7-855d8fc8e5a5 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Flavor limits 0:0:0 {{(pid=124350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 21:42:20.886978 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.virt.hardware [None req-667a5c39-46f9-4d6b-87b7-855d8fc8e5a5 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Image limits 0:0:0 {{(pid=124350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 21:42:20.887511 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.virt.hardware [None req-667a5c39-46f9-4d6b-87b7-855d8fc8e5a5 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Flavor pref 0:0:0 {{(pid=124350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 21:42:20.887985 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.virt.hardware [None req-667a5c39-46f9-4d6b-87b7-855d8fc8e5a5 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Image pref 0:0:0 {{(pid=124350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 21:42:20.888476 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.virt.hardware [None req-667a5c39-46f9-4d6b-87b7-855d8fc8e5a5 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 21:42:20.900095 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-667a5c39-46f9-4d6b-87b7-855d8fc8e5a5 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:42:20.900759 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-667a5c39-46f9-4d6b-87b7-855d8fc8e5a5 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:42:20.901578 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-667a5c39-46f9-4d6b-87b7-855d8fc8e5a5 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:42:20.902017 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-667a5c39-46f9-4d6b-87b7-855d8fc8e5a5 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:42:20.920801 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.quota [None req-667a5c39-46f9-4d6b-87b7-855d8fc8e5a5 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Getting quotas for project 4951b93f86e1485692a4aae7b9ece8f6. Resources: {'ram', 'cores', 'instances'} {{(pid=124350) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 21:42:20.925018 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.quota [None req-667a5c39-46f9-4d6b-87b7-855d8fc8e5a5 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Getting quotas for user 0a58f82117ab437cab5607c204c86547 and project 4951b93f86e1485692a4aae7b9ece8f6. Resources: {'ram', 'cores', 'instances'} {{(pid=124350) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 21:42:20.934339 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-8d996b52-8fc6-4988-9600-a3304f95278d tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:42:20.942839 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-8d996b52-8fc6-4988-9600-a3304f95278d tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:42:20.944419 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-8d996b52-8fc6-4988-9600-a3304f95278d tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:42:20.945589 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-8d996b52-8fc6-4988-9600-a3304f95278d tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8" status: 200 len: 1731 microversion: 2.20 time: 0.182870 May 19 21:42:20.946636 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 427/866] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:42:20 2022] GET /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8 => generated 1731 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:42:20.984436 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-667a5c39-46f9-4d6b-87b7-855d8fc8e5a5 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Going to run 1 instances... {{(pid=124350) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 21:42:20.986756 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-667a5c39-46f9-4d6b-87b7-855d8fc8e5a5 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] [instance: 365bcd45-f5a7-4207-8767-ef081a3f46b7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8a78f114-0bf3-4dee-a14c-19779ee339a5',volume_size=None,volume_type=None)] {{(pid=124350) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 21:42:21.125565 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-667a5c39-46f9-4d6b-87b7-855d8fc8e5a5 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.982102 May 19 21:42:21.130327 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 440/867] 10.222.0.65 () {60 vars in 1146 bytes} [Thu May 19 21:42:20 2022] POST /compute/v2.1/servers => generated 406 bytes in 984 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 21:42:21.138684 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-96f195f6-6142-42ca-8cd2-ce93c48a1a65 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:42:21.139410 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-96f195f6-6142-42ca-8cd2-ce93c48a1a65 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] [instance: 365bcd45-f5a7-4207-8767-ef081a3f46b7] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:42:21.197036 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-96f195f6-6142-42ca-8cd2-ce93c48a1a65 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a58f82117ab437cab5607c204c86547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4951b93f86e1485692a4aae7b9ece8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:42:21.205348 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-96f195f6-6142-42ca-8cd2-ce93c48a1a65 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] 10.222.0.65 "GET /compute/v2.1/servers/365bcd45-f5a7-4207-8767-ef081a3f46b7" status: 200 len: 1095 microversion: 2.1 time: 0.070673 May 19 21:42:21.213625 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 428/868] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:42:21 2022] GET /compute/v2.1/servers/365bcd45-f5a7-4207-8767-ef081a3f46b7 => generated 1095 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:42:21.965564 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-70f97719-2c99-42a5-ab0b-064706b74e83 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:42:21.966218 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-70f97719-2c99-42a5-ab0b-064706b74e83 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: 446bb786-0ec7-4542-9509-36282d7126c8] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:42:21.974134 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-70f97719-2c99-42a5-ab0b-064706b74e83 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:42:21.974612 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-70f97719-2c99-42a5-ab0b-064706b74e83 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:42:21.975365 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-70f97719-2c99-42a5-ab0b-064706b74e83 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:42:21.975789 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-70f97719-2c99-42a5-ab0b-064706b74e83 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:42:22.133794 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-70f97719-2c99-42a5-ab0b-064706b74e83 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:42:22.142478 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-70f97719-2c99-42a5-ab0b-064706b74e83 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:42:22.143971 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-70f97719-2c99-42a5-ab0b-064706b74e83 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:42:22.145138 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-70f97719-2c99-42a5-ab0b-064706b74e83 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8" status: 200 len: 1731 microversion: 2.20 time: 0.184174 May 19 21:42:22.145697 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 441/869] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:42:21 2022] GET /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8 => generated 1731 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:42:22.222259 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-0386cb0e-91a6-4b14-81f4-b946bf6a533f tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:42:22.222817 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-0386cb0e-91a6-4b14-81f4-b946bf6a533f tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] [instance: 365bcd45-f5a7-4207-8767-ef081a3f46b7] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:42:22.230215 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-0386cb0e-91a6-4b14-81f4-b946bf6a533f tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:42:22.230685 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-0386cb0e-91a6-4b14-81f4-b946bf6a533f tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:42:22.231454 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-0386cb0e-91a6-4b14-81f4-b946bf6a533f tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:42:22.231884 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-0386cb0e-91a6-4b14-81f4-b946bf6a533f tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:42:22.294692 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-0386cb0e-91a6-4b14-81f4-b946bf6a533f tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a58f82117ab437cab5607c204c86547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4951b93f86e1485692a4aae7b9ece8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:42:22.302938 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-0386cb0e-91a6-4b14-81f4-b946bf6a533f tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] 10.222.0.65 "GET /compute/v2.1/servers/365bcd45-f5a7-4207-8767-ef081a3f46b7" status: 200 len: 1145 microversion: 2.1 time: 0.084766 May 19 21:42:22.303517 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 429/870] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:42:22 2022] GET /compute/v2.1/servers/365bcd45-f5a7-4207-8767-ef081a3f46b7 => generated 1145 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:42:23.165424 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-294ce2c2-3d95-41c7-995e-469114b63bd0 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:42:23.165978 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-294ce2c2-3d95-41c7-995e-469114b63bd0 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: 446bb786-0ec7-4542-9509-36282d7126c8] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:42:23.173696 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-294ce2c2-3d95-41c7-995e-469114b63bd0 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:42:23.174136 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-294ce2c2-3d95-41c7-995e-469114b63bd0 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:42:23.174987 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-294ce2c2-3d95-41c7-995e-469114b63bd0 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:42:23.175413 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-294ce2c2-3d95-41c7-995e-469114b63bd0 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:42:23.196231 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:42:23.320254 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-f9ae5d06-76a7-4cd4-bbf8-0c763b596c8a tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:42:23.320850 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-f9ae5d06-76a7-4cd4-bbf8-0c763b596c8a tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] [instance: 365bcd45-f5a7-4207-8767-ef081a3f46b7] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:42:23.321259 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-294ce2c2-3d95-41c7-995e-469114b63bd0 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:42:23.328262 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f9ae5d06-76a7-4cd4-bbf8-0c763b596c8a tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:42:23.328710 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f9ae5d06-76a7-4cd4-bbf8-0c763b596c8a tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:42:23.329869 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f9ae5d06-76a7-4cd4-bbf8-0c763b596c8a tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:42:23.330012 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-294ce2c2-3d95-41c7-995e-469114b63bd0 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:42:23.330419 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f9ae5d06-76a7-4cd4-bbf8-0c763b596c8a tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:42:23.331404 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-294ce2c2-3d95-41c7-995e-469114b63bd0 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:42:23.332576 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-294ce2c2-3d95-41c7-995e-469114b63bd0 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8" status: 200 len: 1731 microversion: 2.20 time: 0.171281 May 19 21:42:23.333107 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 442/871] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:42:23 2022] GET /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8 => generated 1731 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:42:23.412322 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-f9ae5d06-76a7-4cd4-bbf8-0c763b596c8a tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a58f82117ab437cab5607c204c86547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4951b93f86e1485692a4aae7b9ece8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:42:23.422759 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-f9ae5d06-76a7-4cd4-bbf8-0c763b596c8a tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] 10.222.0.65 "GET /compute/v2.1/servers/365bcd45-f5a7-4207-8767-ef081a3f46b7" status: 200 len: 1145 microversion: 2.1 time: 0.106021 May 19 21:42:23.423472 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 430/872] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:42:23 2022] GET /compute/v2.1/servers/365bcd45-f5a7-4207-8767-ef081a3f46b7 => generated 1145 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:42:24.356054 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-d1e29d4e-e753-45b7-8c82-cc07ef4ffce7 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:42:24.356685 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-d1e29d4e-e753-45b7-8c82-cc07ef4ffce7 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: 446bb786-0ec7-4542-9509-36282d7126c8] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:42:24.365185 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d1e29d4e-e753-45b7-8c82-cc07ef4ffce7 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:42:24.365657 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d1e29d4e-e753-45b7-8c82-cc07ef4ffce7 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:42:24.366471 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d1e29d4e-e753-45b7-8c82-cc07ef4ffce7 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:42:24.366949 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d1e29d4e-e753-45b7-8c82-cc07ef4ffce7 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:42:24.446202 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-f52d1a35-b72e-403c-9f5a-5c52ad8c9420 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:42:24.446864 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-f52d1a35-b72e-403c-9f5a-5c52ad8c9420 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] [instance: 365bcd45-f5a7-4207-8767-ef081a3f46b7] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:42:24.455037 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f52d1a35-b72e-403c-9f5a-5c52ad8c9420 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:42:24.455496 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f52d1a35-b72e-403c-9f5a-5c52ad8c9420 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:42:24.456294 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f52d1a35-b72e-403c-9f5a-5c52ad8c9420 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:42:24.456693 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f52d1a35-b72e-403c-9f5a-5c52ad8c9420 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:42:24.510761 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-d1e29d4e-e753-45b7-8c82-cc07ef4ffce7 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:42:24.519914 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-d1e29d4e-e753-45b7-8c82-cc07ef4ffce7 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:42:24.520618 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-f52d1a35-b72e-403c-9f5a-5c52ad8c9420 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a58f82117ab437cab5607c204c86547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4951b93f86e1485692a4aae7b9ece8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:42:24.521406 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-d1e29d4e-e753-45b7-8c82-cc07ef4ffce7 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:42:24.522609 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-d1e29d4e-e753-45b7-8c82-cc07ef4ffce7 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8" status: 200 len: 1731 microversion: 2.20 time: 0.170804 May 19 21:42:24.523140 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 443/873] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:42:24 2022] GET /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8 => generated 1731 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:42:24.528265 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-f52d1a35-b72e-403c-9f5a-5c52ad8c9420 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] 10.222.0.65 "GET /compute/v2.1/servers/365bcd45-f5a7-4207-8767-ef081a3f46b7" status: 200 len: 1145 microversion: 2.1 time: 0.089296 May 19 21:42:24.528855 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 431/874] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:42:24 2022] GET /compute/v2.1/servers/365bcd45-f5a7-4207-8767-ef081a3f46b7 => generated 1145 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:42:25.546059 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-4214cd7b-dd8f-422e-9949-8ad0701a0a0b tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:42:25.547002 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-ec795249-0eb0-4c97-9d01-da98b818685d tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:42:25.547513 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-4214cd7b-dd8f-422e-9949-8ad0701a0a0b tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: 446bb786-0ec7-4542-9509-36282d7126c8] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:42:25.547811 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-ec795249-0eb0-4c97-9d01-da98b818685d tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] [instance: 365bcd45-f5a7-4207-8767-ef081a3f46b7] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:42:25.552188 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:42:25.556733 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ec795249-0eb0-4c97-9d01-da98b818685d tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:42:25.557242 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ec795249-0eb0-4c97-9d01-da98b818685d tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:42:25.558076 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ec795249-0eb0-4c97-9d01-da98b818685d tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:42:25.558589 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ec795249-0eb0-4c97-9d01-da98b818685d tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:42:25.559416 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4214cd7b-dd8f-422e-9949-8ad0701a0a0b tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:42:25.559887 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4214cd7b-dd8f-422e-9949-8ad0701a0a0b tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:42:25.560714 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4214cd7b-dd8f-422e-9949-8ad0701a0a0b tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:42:25.561471 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4214cd7b-dd8f-422e-9949-8ad0701a0a0b tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:42:25.625519 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-ec795249-0eb0-4c97-9d01-da98b818685d tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a58f82117ab437cab5607c204c86547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4951b93f86e1485692a4aae7b9ece8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:42:25.634829 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-ec795249-0eb0-4c97-9d01-da98b818685d tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] 10.222.0.65 "GET /compute/v2.1/servers/365bcd45-f5a7-4207-8767-ef081a3f46b7" status: 200 len: 1145 microversion: 2.1 time: 0.092677 May 19 21:42:25.635399 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 432/875] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:42:25 2022] GET /compute/v2.1/servers/365bcd45-f5a7-4207-8767-ef081a3f46b7 => generated 1145 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:42:25.719324 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-4214cd7b-dd8f-422e-9949-8ad0701a0a0b tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:42:25.728311 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-4214cd7b-dd8f-422e-9949-8ad0701a0a0b tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:42:25.729799 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-4214cd7b-dd8f-422e-9949-8ad0701a0a0b tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:42:25.730996 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-4214cd7b-dd8f-422e-9949-8ad0701a0a0b tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8" status: 200 len: 1731 microversion: 2.20 time: 0.191727 May 19 21:42:25.731553 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 444/876] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:42:25 2022] GET /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8 => generated 1731 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:42:26.653624 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-a576eefe-bd70-4001-9ed9-451a8d789c5e tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:42:26.654274 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-a576eefe-bd70-4001-9ed9-451a8d789c5e tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] [instance: 365bcd45-f5a7-4207-8767-ef081a3f46b7] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:42:26.661264 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a576eefe-bd70-4001-9ed9-451a8d789c5e tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:42:26.661714 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a576eefe-bd70-4001-9ed9-451a8d789c5e tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:42:26.662525 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a576eefe-bd70-4001-9ed9-451a8d789c5e tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:42:26.663011 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a576eefe-bd70-4001-9ed9-451a8d789c5e tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:42:26.730615 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-a576eefe-bd70-4001-9ed9-451a8d789c5e tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a58f82117ab437cab5607c204c86547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4951b93f86e1485692a4aae7b9ece8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:42:26.739053 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-a576eefe-bd70-4001-9ed9-451a8d789c5e tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] 10.222.0.65 "GET /compute/v2.1/servers/365bcd45-f5a7-4207-8767-ef081a3f46b7" status: 200 len: 1145 microversion: 2.1 time: 0.089504 May 19 21:42:26.739664 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 433/877] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:42:26 2022] GET /compute/v2.1/servers/365bcd45-f5a7-4207-8767-ef081a3f46b7 => generated 1145 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:42:26.751240 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-688a44a2-1f20-4cd3-80d3-487bf4aed3be tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:42:26.751990 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-688a44a2-1f20-4cd3-80d3-487bf4aed3be tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: 446bb786-0ec7-4542-9509-36282d7126c8] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:42:26.758914 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-688a44a2-1f20-4cd3-80d3-487bf4aed3be tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:42:26.759325 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-688a44a2-1f20-4cd3-80d3-487bf4aed3be tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:42:26.760108 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-688a44a2-1f20-4cd3-80d3-487bf4aed3be tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:42:26.760576 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-688a44a2-1f20-4cd3-80d3-487bf4aed3be tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:42:26.843387 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 21:42:26.843506 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Thu May 19 21:42:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 19 21:42:26.898791 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-688a44a2-1f20-4cd3-80d3-487bf4aed3be tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:42:26.907236 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-688a44a2-1f20-4cd3-80d3-487bf4aed3be tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:42:26.908742 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-688a44a2-1f20-4cd3-80d3-487bf4aed3be tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:42:26.909911 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-688a44a2-1f20-4cd3-80d3-487bf4aed3be tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8" status: 200 len: 1731 microversion: 2.20 time: 0.162610 May 19 21:42:26.910604 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 445/878] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:42:26 2022] GET /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8 => generated 1731 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:42:27.758918 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-2f62b4fa-6a6f-4cb7-b7fe-522c90b06336 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:42:27.759798 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-2f62b4fa-6a6f-4cb7-b7fe-522c90b06336 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] [instance: 365bcd45-f5a7-4207-8767-ef081a3f46b7] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:42:27.767400 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-2f62b4fa-6a6f-4cb7-b7fe-522c90b06336 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:42:27.767990 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-2f62b4fa-6a6f-4cb7-b7fe-522c90b06336 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:42:27.768595 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-2f62b4fa-6a6f-4cb7-b7fe-522c90b06336 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:42:27.769112 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-2f62b4fa-6a6f-4cb7-b7fe-522c90b06336 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:42:27.871462 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-2f62b4fa-6a6f-4cb7-b7fe-522c90b06336 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a58f82117ab437cab5607c204c86547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4951b93f86e1485692a4aae7b9ece8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:42:27.886463 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-2f62b4fa-6a6f-4cb7-b7fe-522c90b06336 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] 10.222.0.65 "GET /compute/v2.1/servers/365bcd45-f5a7-4207-8767-ef081a3f46b7" status: 200 len: 1193 microversion: 2.1 time: 0.130949 May 19 21:42:27.887903 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 434/879] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:42:27 2022] GET /compute/v2.1/servers/365bcd45-f5a7-4207-8767-ef081a3f46b7 => generated 1193 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:42:28.195894 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-fc7f47ec-9fe7-4daa-982e-66c23f01c904 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:42:28.197183 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-fc7f47ec-9fe7-4daa-982e-66c23f01c904 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: 446bb786-0ec7-4542-9509-36282d7126c8] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:42:28.204158 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-fc7f47ec-9fe7-4daa-982e-66c23f01c904 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:42:28.204777 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-fc7f47ec-9fe7-4daa-982e-66c23f01c904 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:42:28.205665 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-fc7f47ec-9fe7-4daa-982e-66c23f01c904 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:42:28.206103 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-fc7f47ec-9fe7-4daa-982e-66c23f01c904 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:42:28.466874 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-fc7f47ec-9fe7-4daa-982e-66c23f01c904 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:42:28.478834 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-fc7f47ec-9fe7-4daa-982e-66c23f01c904 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:42:28.480846 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-fc7f47ec-9fe7-4daa-982e-66c23f01c904 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:42:28.483019 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-fc7f47ec-9fe7-4daa-982e-66c23f01c904 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8" status: 200 len: 1731 microversion: 2.20 time: 0.557999 May 19 21:42:28.483795 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 446/880] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:42:27 2022] GET /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8 => generated 1731 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 21:42:28.905391 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-f9963312-9eb5-448c-8c5f-c9df570984f9 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:42:28.906160 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-f9963312-9eb5-448c-8c5f-c9df570984f9 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] [instance: 365bcd45-f5a7-4207-8767-ef081a3f46b7] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:42:28.913604 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f9963312-9eb5-448c-8c5f-c9df570984f9 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:42:28.914058 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f9963312-9eb5-448c-8c5f-c9df570984f9 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:42:28.914895 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f9963312-9eb5-448c-8c5f-c9df570984f9 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:42:28.915319 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f9963312-9eb5-448c-8c5f-c9df570984f9 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:42:29.098846 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-f9963312-9eb5-448c-8c5f-c9df570984f9 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a58f82117ab437cab5607c204c86547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4951b93f86e1485692a4aae7b9ece8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:42:29.107020 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-f9963312-9eb5-448c-8c5f-c9df570984f9 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] 10.222.0.65 "GET /compute/v2.1/servers/365bcd45-f5a7-4207-8767-ef081a3f46b7" status: 200 len: 1267 microversion: 2.1 time: 0.205838 May 19 21:42:29.117502 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 435/881] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:42:28 2022] GET /compute/v2.1/servers/365bcd45-f5a7-4207-8767-ef081a3f46b7 => generated 1267 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 21:42:29.505193 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-e0b91530-9cc5-4e86-844a-f2577bf35001 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:42:29.506280 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-e0b91530-9cc5-4e86-844a-f2577bf35001 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: 446bb786-0ec7-4542-9509-36282d7126c8] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:42:29.514784 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e0b91530-9cc5-4e86-844a-f2577bf35001 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:42:29.515985 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e0b91530-9cc5-4e86-844a-f2577bf35001 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:42:29.516797 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e0b91530-9cc5-4e86-844a-f2577bf35001 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:42:29.517234 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e0b91530-9cc5-4e86-844a-f2577bf35001 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:42:29.750230 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-e0b91530-9cc5-4e86-844a-f2577bf35001 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:42:29.763297 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-e0b91530-9cc5-4e86-844a-f2577bf35001 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:42:29.766418 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-e0b91530-9cc5-4e86-844a-f2577bf35001 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:42:29.770157 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-e0b91530-9cc5-4e86-844a-f2577bf35001 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8" status: 200 len: 1731 microversion: 2.20 time: 0.270117 May 19 21:42:29.771776 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 447/882] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:42:29 2022] GET /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8 => generated 1731 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:42:29.836220 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [req-562294cb-d1e9-4c83-978c-b8dc452491cf req-11705f34-4f5b-4f23-b4b2-bf1004192d91 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "365bcd45-f5a7-4207-8767-ef081a3f46b7", "tag": "76df0d38-9d1e-444b-9684-faaab6f94a92"}]} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:42:29.860504 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-562294cb-d1e9-4c83-978c-b8dc452491cf req-11705f34-4f5b-4f23-b4b2-bf1004192d91 service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:42:29.861032 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-562294cb-d1e9-4c83-978c-b8dc452491cf req-11705f34-4f5b-4f23-b4b2-bf1004192d91 service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:42:29.873656 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.compute.server_external_events [req-562294cb-d1e9-4c83-978c-b8dc452491cf req-11705f34-4f5b-4f23-b4b2-bf1004192d91 service nova] Creating event network-changed:76df0d38-9d1e-444b-9684-faaab6f94a92 for instance 365bcd45-f5a7-4207-8767-ef081a3f46b7 on hv-cinder-83563 May 19 21:42:29.880072 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [req-562294cb-d1e9-4c83-978c-b8dc452491cf req-11705f34-4f5b-4f23-b4b2-bf1004192d91 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052453 May 19 21:42:29.881048 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 436/883] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 21:42:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 21:42:30.127511 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-f8f8d5e0-8a91-4bf4-9a1b-961aad846936 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:42:30.128140 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-f8f8d5e0-8a91-4bf4-9a1b-961aad846936 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] [instance: 365bcd45-f5a7-4207-8767-ef081a3f46b7] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:42:30.135215 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f8f8d5e0-8a91-4bf4-9a1b-961aad846936 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:42:30.135658 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f8f8d5e0-8a91-4bf4-9a1b-961aad846936 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:42:30.136558 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f8f8d5e0-8a91-4bf4-9a1b-961aad846936 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:42:30.137146 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f8f8d5e0-8a91-4bf4-9a1b-961aad846936 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:42:30.346696 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-f8f8d5e0-8a91-4bf4-9a1b-961aad846936 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a58f82117ab437cab5607c204c86547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4951b93f86e1485692a4aae7b9ece8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:42:30.356361 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-f8f8d5e0-8a91-4bf4-9a1b-961aad846936 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] 10.222.0.65 "GET /compute/v2.1/servers/365bcd45-f5a7-4207-8767-ef081a3f46b7" status: 200 len: 1267 microversion: 2.1 time: 0.235018 May 19 21:42:30.356959 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 448/884] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:42:30 2022] GET /compute/v2.1/servers/365bcd45-f5a7-4207-8767-ef081a3f46b7 => generated 1267 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:42:30.790529 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-91534ae5-84fa-46e8-9d25-7410451e9ea1 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:42:30.791187 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-91534ae5-84fa-46e8-9d25-7410451e9ea1 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: 446bb786-0ec7-4542-9509-36282d7126c8] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:42:30.798403 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-91534ae5-84fa-46e8-9d25-7410451e9ea1 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:42:30.799078 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-91534ae5-84fa-46e8-9d25-7410451e9ea1 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:42:30.799607 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-91534ae5-84fa-46e8-9d25-7410451e9ea1 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:42:30.800034 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-91534ae5-84fa-46e8-9d25-7410451e9ea1 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:42:30.936142 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-91534ae5-84fa-46e8-9d25-7410451e9ea1 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:42:30.945240 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-91534ae5-84fa-46e8-9d25-7410451e9ea1 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:42:30.948050 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-91534ae5-84fa-46e8-9d25-7410451e9ea1 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:42:30.948050 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-91534ae5-84fa-46e8-9d25-7410451e9ea1 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8" status: 200 len: 1731 microversion: 2.20 time: 0.162456 May 19 21:42:30.949036 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 437/885] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:42:30 2022] GET /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8 => generated 1731 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:42:31.291987 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [req-d574e338-71db-42e3-bbd9-cad24722a7e6 req-9bc20163-29f7-4c8e-853d-e3cca17ae238 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "446bb786-0ec7-4542-9509-36282d7126c8", "name": "network-vif-plugged", "status": "completed", "tag": "a93c27fd-fadb-4f8a-be75-eddb5e3c3921"}]} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:42:31.296094 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell0:SELECT=2 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:42:31.296728 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell0:SELECT=6 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:42:31.310746 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-d574e338-71db-42e3-bbd9-cad24722a7e6 req-9bc20163-29f7-4c8e-853d-e3cca17ae238 service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:42:31.311865 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-d574e338-71db-42e3-bbd9-cad24722a7e6 req-9bc20163-29f7-4c8e-853d-e3cca17ae238 service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:42:31.325797 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.compute.server_external_events [req-d574e338-71db-42e3-bbd9-cad24722a7e6 req-9bc20163-29f7-4c8e-853d-e3cca17ae238 service nova] Creating event network-vif-plugged:a93c27fd-fadb-4f8a-be75-eddb5e3c3921 for instance 446bb786-0ec7-4542-9509-36282d7126c8 on hv-cinder-83563 May 19 21:42:31.332192 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [req-d574e338-71db-42e3-bbd9-cad24722a7e6 req-9bc20163-29f7-4c8e-853d-e3cca17ae238 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043833 May 19 21:42:31.332844 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 449/886] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 21:42:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 21:42:31.373395 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-2495fa34-342c-445e-a7d5-9a0c99891562 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:42:31.374013 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-2495fa34-342c-445e-a7d5-9a0c99891562 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] [instance: 365bcd45-f5a7-4207-8767-ef081a3f46b7] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:42:31.376078 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_cell0:SELECT=2 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:42:31.381875 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-2495fa34-342c-445e-a7d5-9a0c99891562 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:42:31.382357 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-2495fa34-342c-445e-a7d5-9a0c99891562 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:42:31.383142 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-2495fa34-342c-445e-a7d5-9a0c99891562 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:42:31.383966 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-2495fa34-342c-445e-a7d5-9a0c99891562 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:42:31.550774 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-2495fa34-342c-445e-a7d5-9a0c99891562 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a58f82117ab437cab5607c204c86547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4951b93f86e1485692a4aae7b9ece8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:42:31.558666 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-2495fa34-342c-445e-a7d5-9a0c99891562 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] 10.222.0.65 "GET /compute/v2.1/servers/365bcd45-f5a7-4207-8767-ef081a3f46b7" status: 200 len: 1267 microversion: 2.1 time: 0.189201 May 19 21:42:31.559212 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 438/887] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:42:31 2022] GET /compute/v2.1/servers/365bcd45-f5a7-4207-8767-ef081a3f46b7 => generated 1267 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:42:31.973810 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-7f10f576-fec1-4579-a8fa-e2a563d31c58 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:42:31.974495 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-7f10f576-fec1-4579-a8fa-e2a563d31c58 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: 446bb786-0ec7-4542-9509-36282d7126c8] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:42:31.981017 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7f10f576-fec1-4579-a8fa-e2a563d31c58 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:42:31.981460 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7f10f576-fec1-4579-a8fa-e2a563d31c58 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:42:31.982222 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7f10f576-fec1-4579-a8fa-e2a563d31c58 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:42:31.982675 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7f10f576-fec1-4579-a8fa-e2a563d31c58 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:42:32.134735 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-7f10f576-fec1-4579-a8fa-e2a563d31c58 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:42:32.146495 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-7f10f576-fec1-4579-a8fa-e2a563d31c58 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:42:32.148032 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-7f10f576-fec1-4579-a8fa-e2a563d31c58 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:42:32.149234 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-7f10f576-fec1-4579-a8fa-e2a563d31c58 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8" status: 200 len: 1731 microversion: 2.20 time: 0.180402 May 19 21:42:32.149782 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 450/888] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:42:31 2022] GET /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8 => generated 1731 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:42:32.576556 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-6844e931-f5a8-4911-acba-25fb64c28105 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:42:32.577160 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-6844e931-f5a8-4911-acba-25fb64c28105 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] [instance: 365bcd45-f5a7-4207-8767-ef081a3f46b7] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:42:32.585021 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-6844e931-f5a8-4911-acba-25fb64c28105 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:42:32.585481 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-6844e931-f5a8-4911-acba-25fb64c28105 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:42:32.586270 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-6844e931-f5a8-4911-acba-25fb64c28105 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:42:32.586752 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-6844e931-f5a8-4911-acba-25fb64c28105 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:42:32.745655 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-6844e931-f5a8-4911-acba-25fb64c28105 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a58f82117ab437cab5607c204c86547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4951b93f86e1485692a4aae7b9ece8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:42:32.753516 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-6844e931-f5a8-4911-acba-25fb64c28105 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] 10.222.0.65 "GET /compute/v2.1/servers/365bcd45-f5a7-4207-8767-ef081a3f46b7" status: 200 len: 1267 microversion: 2.1 time: 0.181408 May 19 21:42:32.754129 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 439/889] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:42:32 2022] GET /compute/v2.1/servers/365bcd45-f5a7-4207-8767-ef081a3f46b7 => generated 1267 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:42:33.170508 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-d7e9dd3c-5869-4d56-9a2b-63383bac2ef4 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:42:33.171459 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-d7e9dd3c-5869-4d56-9a2b-63383bac2ef4 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: 446bb786-0ec7-4542-9509-36282d7126c8] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:42:33.181424 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d7e9dd3c-5869-4d56-9a2b-63383bac2ef4 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:42:33.182139 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d7e9dd3c-5869-4d56-9a2b-63383bac2ef4 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:42:33.183342 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d7e9dd3c-5869-4d56-9a2b-63383bac2ef4 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:42:33.183975 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d7e9dd3c-5869-4d56-9a2b-63383bac2ef4 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:42:33.331559 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-d7e9dd3c-5869-4d56-9a2b-63383bac2ef4 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:42:33.340252 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-d7e9dd3c-5869-4d56-9a2b-63383bac2ef4 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:42:33.341733 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-d7e9dd3c-5869-4d56-9a2b-63383bac2ef4 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:42:33.342923 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-d7e9dd3c-5869-4d56-9a2b-63383bac2ef4 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8" status: 200 len: 1731 microversion: 2.20 time: 0.178659 May 19 21:42:33.343478 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 451/890] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:42:33 2022] GET /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8 => generated 1731 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:42:33.771215 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-038dd45b-db60-4fb9-801e-fd82b82d2d1f tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:42:33.771857 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-038dd45b-db60-4fb9-801e-fd82b82d2d1f tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] [instance: 365bcd45-f5a7-4207-8767-ef081a3f46b7] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:42:33.778701 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-038dd45b-db60-4fb9-801e-fd82b82d2d1f tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:42:33.779140 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-038dd45b-db60-4fb9-801e-fd82b82d2d1f tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:42:33.779908 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-038dd45b-db60-4fb9-801e-fd82b82d2d1f tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:42:33.780362 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-038dd45b-db60-4fb9-801e-fd82b82d2d1f tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:42:33.921642 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-038dd45b-db60-4fb9-801e-fd82b82d2d1f tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a58f82117ab437cab5607c204c86547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4951b93f86e1485692a4aae7b9ece8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:42:33.929328 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-038dd45b-db60-4fb9-801e-fd82b82d2d1f tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] 10.222.0.65 "GET /compute/v2.1/servers/365bcd45-f5a7-4207-8767-ef081a3f46b7" status: 200 len: 1267 microversion: 2.1 time: 0.162048 May 19 21:42:33.929881 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 440/891] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:42:33 2022] GET /compute/v2.1/servers/365bcd45-f5a7-4207-8767-ef081a3f46b7 => generated 1267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:42:34.361521 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-6a66ddde-05be-489e-ac33-a374dcc7ed58 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:42:34.362232 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-6a66ddde-05be-489e-ac33-a374dcc7ed58 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: 446bb786-0ec7-4542-9509-36282d7126c8] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:42:34.369595 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6a66ddde-05be-489e-ac33-a374dcc7ed58 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:42:34.370043 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6a66ddde-05be-489e-ac33-a374dcc7ed58 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:42:34.370839 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6a66ddde-05be-489e-ac33-a374dcc7ed58 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:42:34.371325 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6a66ddde-05be-489e-ac33-a374dcc7ed58 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:42:34.512110 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-6a66ddde-05be-489e-ac33-a374dcc7ed58 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:42:34.522588 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-6a66ddde-05be-489e-ac33-a374dcc7ed58 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:42:34.524124 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-6a66ddde-05be-489e-ac33-a374dcc7ed58 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:42:34.525687 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-6a66ddde-05be-489e-ac33-a374dcc7ed58 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8" status: 200 len: 1731 microversion: 2.20 time: 0.167943 May 19 21:42:34.526254 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 452/892] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:42:34 2022] GET /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8 => generated 1731 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:42:34.947502 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-bc9d01ff-4b7a-47ff-85b3-ef260b863c31 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:42:34.948630 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-bc9d01ff-4b7a-47ff-85b3-ef260b863c31 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] [instance: 365bcd45-f5a7-4207-8767-ef081a3f46b7] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:42:34.955376 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-bc9d01ff-4b7a-47ff-85b3-ef260b863c31 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:42:34.955819 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-bc9d01ff-4b7a-47ff-85b3-ef260b863c31 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:42:34.956582 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-bc9d01ff-4b7a-47ff-85b3-ef260b863c31 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:42:34.956984 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-bc9d01ff-4b7a-47ff-85b3-ef260b863c31 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:42:35.107159 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-bc9d01ff-4b7a-47ff-85b3-ef260b863c31 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a58f82117ab437cab5607c204c86547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4951b93f86e1485692a4aae7b9ece8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:42:35.115914 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-bc9d01ff-4b7a-47ff-85b3-ef260b863c31 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] 10.222.0.65 "GET /compute/v2.1/servers/365bcd45-f5a7-4207-8767-ef081a3f46b7" status: 200 len: 1267 microversion: 2.1 time: 0.173297 May 19 21:42:35.116499 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 441/893] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:42:34 2022] GET /compute/v2.1/servers/365bcd45-f5a7-4207-8767-ef081a3f46b7 => generated 1267 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:42:35.545776 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-40ea1f75-e6ff-42ed-a701-8c073d607b57 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:42:35.546403 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-40ea1f75-e6ff-42ed-a701-8c073d607b57 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: 446bb786-0ec7-4542-9509-36282d7126c8] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:42:35.553905 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-40ea1f75-e6ff-42ed-a701-8c073d607b57 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:42:35.554530 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-40ea1f75-e6ff-42ed-a701-8c073d607b57 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:42:35.555435 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-40ea1f75-e6ff-42ed-a701-8c073d607b57 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:42:35.555879 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-40ea1f75-e6ff-42ed-a701-8c073d607b57 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:42:35.709096 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-40ea1f75-e6ff-42ed-a701-8c073d607b57 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:42:35.718772 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-40ea1f75-e6ff-42ed-a701-8c073d607b57 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:42:35.720377 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-40ea1f75-e6ff-42ed-a701-8c073d607b57 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:42:35.721569 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-40ea1f75-e6ff-42ed-a701-8c073d607b57 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8" status: 200 len: 1718 microversion: 2.20 time: 0.180350 May 19 21:42:35.722123 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 453/894] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:42:35 2022] GET /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8 => generated 1718 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:42:36.133261 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-cd283869-8c8a-4bfd-8426-84822e90a3d0 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:42:36.133825 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-cd283869-8c8a-4bfd-8426-84822e90a3d0 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] [instance: 365bcd45-f5a7-4207-8767-ef081a3f46b7] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:42:36.140786 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-cd283869-8c8a-4bfd-8426-84822e90a3d0 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:42:36.141234 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-cd283869-8c8a-4bfd-8426-84822e90a3d0 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:42:36.142002 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-cd283869-8c8a-4bfd-8426-84822e90a3d0 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:42:36.142471 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-cd283869-8c8a-4bfd-8426-84822e90a3d0 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:42:36.289602 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-cd283869-8c8a-4bfd-8426-84822e90a3d0 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a58f82117ab437cab5607c204c86547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4951b93f86e1485692a4aae7b9ece8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:42:36.300196 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-cd283869-8c8a-4bfd-8426-84822e90a3d0 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] 10.222.0.65 "GET /compute/v2.1/servers/365bcd45-f5a7-4207-8767-ef081a3f46b7" status: 200 len: 1267 microversion: 2.1 time: 0.170689 May 19 21:42:36.301996 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 442/895] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:42:36 2022] GET /compute/v2.1/servers/365bcd45-f5a7-4207-8767-ef081a3f46b7 => generated 1267 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:42:37.319255 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-6d831877-3120-43df-890f-595519f2b60c tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:42:37.319971 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-6d831877-3120-43df-890f-595519f2b60c tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] [instance: 365bcd45-f5a7-4207-8767-ef081a3f46b7] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:42:37.327306 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6d831877-3120-43df-890f-595519f2b60c tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:42:37.327756 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6d831877-3120-43df-890f-595519f2b60c tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:42:37.328528 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6d831877-3120-43df-890f-595519f2b60c tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:42:37.328955 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-6d831877-3120-43df-890f-595519f2b60c tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:42:37.474946 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-6d831877-3120-43df-890f-595519f2b60c tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a58f82117ab437cab5607c204c86547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4951b93f86e1485692a4aae7b9ece8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:42:37.483401 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-6d831877-3120-43df-890f-595519f2b60c tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] 10.222.0.65 "GET /compute/v2.1/servers/365bcd45-f5a7-4207-8767-ef081a3f46b7" status: 200 len: 1267 microversion: 2.1 time: 0.168513 May 19 21:42:37.483961 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 454/896] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:42:37 2022] GET /compute/v2.1/servers/365bcd45-f5a7-4207-8767-ef081a3f46b7 => generated 1267 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:42:38.502558 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-28505d6e-d839-427c-a116-f3eb5e4bd06a tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:42:38.503147 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-28505d6e-d839-427c-a116-f3eb5e4bd06a tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] [instance: 365bcd45-f5a7-4207-8767-ef081a3f46b7] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:42:38.510921 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-28505d6e-d839-427c-a116-f3eb5e4bd06a tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:42:38.511357 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-28505d6e-d839-427c-a116-f3eb5e4bd06a tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:42:38.512130 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-28505d6e-d839-427c-a116-f3eb5e4bd06a tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:42:38.512558 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-28505d6e-d839-427c-a116-f3eb5e4bd06a tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:42:38.528187 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_cell1:SELECT=100 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:42:38.653036 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-28505d6e-d839-427c-a116-f3eb5e4bd06a tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a58f82117ab437cab5607c204c86547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4951b93f86e1485692a4aae7b9ece8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:42:38.660911 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-28505d6e-d839-427c-a116-f3eb5e4bd06a tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] 10.222.0.65 "GET /compute/v2.1/servers/365bcd45-f5a7-4207-8767-ef081a3f46b7" status: 200 len: 1267 microversion: 2.1 time: 0.162251 May 19 21:42:38.661487 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 443/897] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:42:38 2022] GET /compute/v2.1/servers/365bcd45-f5a7-4207-8767-ef081a3f46b7 => generated 1267 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:42:39.680335 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-ccff8393-45c2-4ed2-8d5e-160acde49b68 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:42:39.680925 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-ccff8393-45c2-4ed2-8d5e-160acde49b68 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] [instance: 365bcd45-f5a7-4207-8767-ef081a3f46b7] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:42:39.688971 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ccff8393-45c2-4ed2-8d5e-160acde49b68 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:42:39.689683 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ccff8393-45c2-4ed2-8d5e-160acde49b68 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:42:39.690481 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ccff8393-45c2-4ed2-8d5e-160acde49b68 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:42:39.690888 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ccff8393-45c2-4ed2-8d5e-160acde49b68 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:42:39.846903 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-ccff8393-45c2-4ed2-8d5e-160acde49b68 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a58f82117ab437cab5607c204c86547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4951b93f86e1485692a4aae7b9ece8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:42:39.855319 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-ccff8393-45c2-4ed2-8d5e-160acde49b68 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] 10.222.0.65 "GET /compute/v2.1/servers/365bcd45-f5a7-4207-8767-ef081a3f46b7" status: 200 len: 1267 microversion: 2.1 time: 0.179748 May 19 21:42:39.855930 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 455/898] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:42:39 2022] GET /compute/v2.1/servers/365bcd45-f5a7-4207-8767-ef081a3f46b7 => generated 1267 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:42:40.873101 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-623029b4-21aa-4ee0-8169-cca93c3526e1 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:42:40.873709 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-623029b4-21aa-4ee0-8169-cca93c3526e1 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] [instance: 365bcd45-f5a7-4207-8767-ef081a3f46b7] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:42:40.881647 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-623029b4-21aa-4ee0-8169-cca93c3526e1 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:42:40.882201 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-623029b4-21aa-4ee0-8169-cca93c3526e1 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:42:40.883052 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-623029b4-21aa-4ee0-8169-cca93c3526e1 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:42:40.883501 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-623029b4-21aa-4ee0-8169-cca93c3526e1 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:42:41.043129 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-623029b4-21aa-4ee0-8169-cca93c3526e1 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a58f82117ab437cab5607c204c86547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4951b93f86e1485692a4aae7b9ece8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:42:41.054002 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-623029b4-21aa-4ee0-8169-cca93c3526e1 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] 10.222.0.65 "GET /compute/v2.1/servers/365bcd45-f5a7-4207-8767-ef081a3f46b7" status: 200 len: 1267 microversion: 2.1 time: 0.185008 May 19 21:42:41.054847 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 444/899] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:42:40 2022] GET /compute/v2.1/servers/365bcd45-f5a7-4207-8767-ef081a3f46b7 => generated 1267 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:42:42.072024 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-478015b2-8f2e-471c-acfb-6f5cd01ef746 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:42:42.072607 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-478015b2-8f2e-471c-acfb-6f5cd01ef746 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] [instance: 365bcd45-f5a7-4207-8767-ef081a3f46b7] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:42:42.081301 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-478015b2-8f2e-471c-acfb-6f5cd01ef746 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:42:42.081739 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-478015b2-8f2e-471c-acfb-6f5cd01ef746 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:42:42.082545 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-478015b2-8f2e-471c-acfb-6f5cd01ef746 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:42:42.082976 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-478015b2-8f2e-471c-acfb-6f5cd01ef746 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:42:42.234107 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-478015b2-8f2e-471c-acfb-6f5cd01ef746 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a58f82117ab437cab5607c204c86547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4951b93f86e1485692a4aae7b9ece8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:42:42.241742 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-478015b2-8f2e-471c-acfb-6f5cd01ef746 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] 10.222.0.65 "GET /compute/v2.1/servers/365bcd45-f5a7-4207-8767-ef081a3f46b7" status: 200 len: 1267 microversion: 2.1 time: 0.173952 May 19 21:42:42.242338 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 456/900] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:42:42 2022] GET /compute/v2.1/servers/365bcd45-f5a7-4207-8767-ef081a3f46b7 => generated 1267 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:42:43.259099 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-7f1e3252-521f-4c9f-bed5-8ea1b9394fbc tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:42:43.260194 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-7f1e3252-521f-4c9f-bed5-8ea1b9394fbc tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] [instance: 365bcd45-f5a7-4207-8767-ef081a3f46b7] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:42:43.268980 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-7f1e3252-521f-4c9f-bed5-8ea1b9394fbc tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:42:43.269429 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-7f1e3252-521f-4c9f-bed5-8ea1b9394fbc tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:42:43.270230 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-7f1e3252-521f-4c9f-bed5-8ea1b9394fbc tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:42:43.270699 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-7f1e3252-521f-4c9f-bed5-8ea1b9394fbc tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:42:43.346166 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [req-43488470-6671-4dcf-9693-9c5f043d0c54 req-9f0fb9ba-87d1-4901-ac6b-c2f9fc161055 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "365bcd45-f5a7-4207-8767-ef081a3f46b7", "name": "network-vif-plugged", "status": "completed", "tag": "76df0d38-9d1e-444b-9684-faaab6f94a92"}]} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:42:43.364480 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-43488470-6671-4dcf-9693-9c5f043d0c54 req-9f0fb9ba-87d1-4901-ac6b-c2f9fc161055 service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:42:43.364935 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-43488470-6671-4dcf-9693-9c5f043d0c54 req-9f0fb9ba-87d1-4901-ac6b-c2f9fc161055 service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:42:43.377476 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.compute.server_external_events [req-43488470-6671-4dcf-9693-9c5f043d0c54 req-9f0fb9ba-87d1-4901-ac6b-c2f9fc161055 service nova] Creating event network-vif-plugged:76df0d38-9d1e-444b-9684-faaab6f94a92 for instance 365bcd45-f5a7-4207-8767-ef081a3f46b7 on hv-cinder-83563 May 19 21:42:43.383773 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [req-43488470-6671-4dcf-9693-9c5f043d0c54 req-9f0fb9ba-87d1-4901-ac6b-c2f9fc161055 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041055 May 19 21:42:43.384718 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 457/901] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 21:42:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 21:42:43.417728 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-7f1e3252-521f-4c9f-bed5-8ea1b9394fbc tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a58f82117ab437cab5607c204c86547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4951b93f86e1485692a4aae7b9ece8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:42:43.427598 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-7f1e3252-521f-4c9f-bed5-8ea1b9394fbc tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] 10.222.0.65 "GET /compute/v2.1/servers/365bcd45-f5a7-4207-8767-ef081a3f46b7" status: 200 len: 1267 microversion: 2.1 time: 0.172529 May 19 21:42:43.429212 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 445/902] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:42:43 2022] GET /compute/v2.1/servers/365bcd45-f5a7-4207-8767-ef081a3f46b7 => generated 1267 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:42:44.446869 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-f5a7c6c4-995e-451f-a3c0-69e5e0d02ad0 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:42:44.447578 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-f5a7c6c4-995e-451f-a3c0-69e5e0d02ad0 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] [instance: 365bcd45-f5a7-4207-8767-ef081a3f46b7] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:42:44.455156 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f5a7c6c4-995e-451f-a3c0-69e5e0d02ad0 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:42:44.455601 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f5a7c6c4-995e-451f-a3c0-69e5e0d02ad0 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:42:44.456368 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f5a7c6c4-995e-451f-a3c0-69e5e0d02ad0 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:42:44.456796 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f5a7c6c4-995e-451f-a3c0-69e5e0d02ad0 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:42:44.598272 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-f5a7c6c4-995e-451f-a3c0-69e5e0d02ad0 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a58f82117ab437cab5607c204c86547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4951b93f86e1485692a4aae7b9ece8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:42:44.606010 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-f5a7c6c4-995e-451f-a3c0-69e5e0d02ad0 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] 10.222.0.65 "GET /compute/v2.1/servers/365bcd45-f5a7-4207-8767-ef081a3f46b7" status: 200 len: 1267 microversion: 2.1 time: 0.164984 May 19 21:42:44.606680 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 458/903] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:42:44 2022] GET /compute/v2.1/servers/365bcd45-f5a7-4207-8767-ef081a3f46b7 => generated 1267 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:42:45.622858 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-833d2d39-f758-4776-87e2-07197d74d136 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:42:45.623478 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-833d2d39-f758-4776-87e2-07197d74d136 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] [instance: 365bcd45-f5a7-4207-8767-ef081a3f46b7] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:42:45.630683 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-833d2d39-f758-4776-87e2-07197d74d136 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:42:45.631130 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-833d2d39-f758-4776-87e2-07197d74d136 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:42:45.631895 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-833d2d39-f758-4776-87e2-07197d74d136 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:42:45.632324 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-833d2d39-f758-4776-87e2-07197d74d136 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:42:45.773152 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-833d2d39-f758-4776-87e2-07197d74d136 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a58f82117ab437cab5607c204c86547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4951b93f86e1485692a4aae7b9ece8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:42:45.784560 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-833d2d39-f758-4776-87e2-07197d74d136 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] 10.222.0.65 "GET /compute/v2.1/servers/365bcd45-f5a7-4207-8767-ef081a3f46b7" status: 200 len: 1267 microversion: 2.1 time: 0.165658 May 19 21:42:45.785157 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 446/904] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:42:45 2022] GET /compute/v2.1/servers/365bcd45-f5a7-4207-8767-ef081a3f46b7 => generated 1267 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:42:46.805400 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-a2faf03f-4e08-48de-9db1-86f08131f8d6 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:42:46.806227 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-a2faf03f-4e08-48de-9db1-86f08131f8d6 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] [instance: 365bcd45-f5a7-4207-8767-ef081a3f46b7] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:42:46.813256 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a2faf03f-4e08-48de-9db1-86f08131f8d6 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:42:46.813703 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a2faf03f-4e08-48de-9db1-86f08131f8d6 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:42:46.814501 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a2faf03f-4e08-48de-9db1-86f08131f8d6 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:42:46.814934 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a2faf03f-4e08-48de-9db1-86f08131f8d6 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:42:46.964302 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-a2faf03f-4e08-48de-9db1-86f08131f8d6 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a58f82117ab437cab5607c204c86547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4951b93f86e1485692a4aae7b9ece8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:42:46.972236 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-a2faf03f-4e08-48de-9db1-86f08131f8d6 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] 10.222.0.65 "GET /compute/v2.1/servers/365bcd45-f5a7-4207-8767-ef081a3f46b7" status: 200 len: 1453 microversion: 2.1 time: 0.172811 May 19 21:42:46.972805 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 459/905] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:42:46 2022] GET /compute/v2.1/servers/365bcd45-f5a7-4207-8767-ef081a3f46b7 => generated 1453 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:42:46.995115 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-64841147-0041-4f40-bafe-f98442d9dec8 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:42:46.995680 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-64841147-0041-4f40-bafe-f98442d9dec8 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] [instance: 365bcd45-f5a7-4207-8767-ef081a3f46b7] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:42:47.002579 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-64841147-0041-4f40-bafe-f98442d9dec8 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:42:47.003018 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-64841147-0041-4f40-bafe-f98442d9dec8 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:42:47.003775 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-64841147-0041-4f40-bafe-f98442d9dec8 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:42:47.004197 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-64841147-0041-4f40-bafe-f98442d9dec8 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:42:47.151015 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-64841147-0041-4f40-bafe-f98442d9dec8 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a58f82117ab437cab5607c204c86547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4951b93f86e1485692a4aae7b9ece8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:42:47.159641 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-64841147-0041-4f40-bafe-f98442d9dec8 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] 10.222.0.65 "GET /compute/v2.1/servers/365bcd45-f5a7-4207-8767-ef081a3f46b7" status: 200 len: 1453 microversion: 2.1 time: 0.169873 May 19 21:42:47.160214 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 447/906] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:42:46 2022] GET /compute/v2.1/servers/365bcd45-f5a7-4207-8767-ef081a3f46b7 => generated 1453 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:42:49.252178 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [req-b91d0f30-24e4-45d5-8504-4895126737ad req-d0e5cbb6-be7d-4b9c-8d1d-0933afddeba5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "365bcd45-f5a7-4207-8767-ef081a3f46b7", "tag": "76df0d38-9d1e-444b-9684-faaab6f94a92"}]} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:42:49.261854 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-b91d0f30-24e4-45d5-8504-4895126737ad req-d0e5cbb6-be7d-4b9c-8d1d-0933afddeba5 service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:42:49.262280 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-b91d0f30-24e4-45d5-8504-4895126737ad req-d0e5cbb6-be7d-4b9c-8d1d-0933afddeba5 service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:42:49.279611 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.compute.server_external_events [req-b91d0f30-24e4-45d5-8504-4895126737ad req-d0e5cbb6-be7d-4b9c-8d1d-0933afddeba5 service nova] Creating event network-changed:76df0d38-9d1e-444b-9684-faaab6f94a92 for instance 365bcd45-f5a7-4207-8767-ef081a3f46b7 on hv-cinder-83563 May 19 21:42:49.285042 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [req-b91d0f30-24e4-45d5-8504-4895126737ad req-d0e5cbb6-be7d-4b9c-8d1d-0933afddeba5 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036774 May 19 21:42:49.286078 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 460/907] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 21:42:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 21:42:54.063232 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-c7853a7a-9db2-42c2-9603-53216d486e68 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:42:54.063837 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-c7853a7a-9db2-42c2-9603-53216d486e68 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] [instance: c9b67820-7cf5-4a53-9394-c967b6fc2975] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:42:54.066551 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_api:SELECT=44 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:42:54.073788 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c7853a7a-9db2-42c2-9603-53216d486e68 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:42:54.074229 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c7853a7a-9db2-42c2-9603-53216d486e68 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:42:54.075012 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c7853a7a-9db2-42c2-9603-53216d486e68 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:42:54.075442 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c7853a7a-9db2-42c2-9603-53216d486e68 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:42:54.101861 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-c7853a7a-9db2-42c2-9603-53216d486e68 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] 10.222.0.65 "GET /compute/v2.1/servers/c9b67820-7cf5-4a53-9394-c967b6fc2975/ips" status: 200 len: 146 microversion: 2.1 time: 0.044579 May 19 21:42:54.102486 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 448/908] 10.222.0.65 () {58 vars in 1247 bytes} [Thu May 19 21:42:54 2022] GET /compute/v2.1/servers/c9b67820-7cf5-4a53-9394-c967b6fc2975/ips => generated 146 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 21:42:55.458547 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-a2c537f5-5d20-40fa-becb-0d46c98b7f6d tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "87b0fa4b-97e0-4509-bb42-42a2a53f2314"}} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:42:55.459677 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-a2c537f5-5d20-40fa-becb-0d46c98b7f6d tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] [instance: c9b67820-7cf5-4a53-9394-c967b6fc2975] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:42:55.469123 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a2c537f5-5d20-40fa-becb-0d46c98b7f6d tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:42:55.472690 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a2c537f5-5d20-40fa-becb-0d46c98b7f6d tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:42:55.473764 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a2c537f5-5d20-40fa-becb-0d46c98b7f6d tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:42:55.474302 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a2c537f5-5d20-40fa-becb-0d46c98b7f6d tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:42:55.479201 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell1:SELECT=99 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:42:55.736745 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-a2c537f5-5d20-40fa-becb-0d46c98b7f6d tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] 10.222.0.65 "POST /compute/v2.1/servers/c9b67820-7cf5-4a53-9394-c967b6fc2975/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.282806 May 19 21:42:55.741897 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 461/909] 10.222.0.65 () {60 vars in 1322 bytes} [Thu May 19 21:42:55 2022] POST /compute/v2.1/servers/c9b67820-7cf5-4a53-9394-c967b6fc2975/os-volume_attachments => generated 194 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 21:43:03.303275 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-01860a05-a483-4e29-8522-974bc81e5555 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:43:03.304263 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-01860a05-a483-4e29-8522-974bc81e5555 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] [instance: c9b67820-7cf5-4a53-9394-c967b6fc2975] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:43:03.311516 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-01860a05-a483-4e29-8522-974bc81e5555 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:43:03.311954 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-01860a05-a483-4e29-8522-974bc81e5555 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:43:03.312710 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-01860a05-a483-4e29-8522-974bc81e5555 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:43:03.313145 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-01860a05-a483-4e29-8522-974bc81e5555 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:43:03.346084 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-01860a05-a483-4e29-8522-974bc81e5555 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] 10.222.0.65 "GET /compute/v2.1/servers/c9b67820-7cf5-4a53-9394-c967b6fc2975/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046864 May 19 21:43:03.346683 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 449/910] 10.222.0.65 () {58 vars in 1301 bytes} [Thu May 19 21:43:03 2022] GET /compute/v2.1/servers/c9b67820-7cf5-4a53-9394-c967b6fc2975/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 21:43:03.358526 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-cba263e0-355e-4b85-bf47-3f430cac3886 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:43:03.359130 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-cba263e0-355e-4b85-bf47-3f430cac3886 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] [instance: c9b67820-7cf5-4a53-9394-c967b6fc2975] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:43:03.361146 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_api:SELECT=36 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:43:03.367463 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cba263e0-355e-4b85-bf47-3f430cac3886 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:43:03.367911 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cba263e0-355e-4b85-bf47-3f430cac3886 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:43:03.368694 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cba263e0-355e-4b85-bf47-3f430cac3886 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:43:03.369129 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cba263e0-355e-4b85-bf47-3f430cac3886 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:43:03.400384 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-cba263e0-355e-4b85-bf47-3f430cac3886 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] 10.222.0.65 "GET /compute/v2.1/servers/c9b67820-7cf5-4a53-9394-c967b6fc2975/os-volume_attachments/87b0fa4b-97e0-4509-bb42-42a2a53f2314" status: 200 len: 194 microversion: 2.1 time: 0.046873 May 19 21:43:03.400962 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 462/911] 10.222.0.65 () {58 vars in 1412 bytes} [Thu May 19 21:43:03 2022] GET /compute/v2.1/servers/c9b67820-7cf5-4a53-9394-c967b6fc2975/os-volume_attachments/87b0fa4b-97e0-4509-bb42-42a2a53f2314 => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 21:43:04.789736 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-94d14ef7-e291-4fb2-81c5-a09c935dd5ff tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "36e7451e-e453-4320-9d81-c38d48d6219b"}} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:43:04.790959 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-94d14ef7-e291-4fb2-81c5-a09c935dd5ff tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] [instance: c9b67820-7cf5-4a53-9394-c967b6fc2975] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:43:04.799215 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-94d14ef7-e291-4fb2-81c5-a09c935dd5ff tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:43:04.799659 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-94d14ef7-e291-4fb2-81c5-a09c935dd5ff tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:43:04.800446 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-94d14ef7-e291-4fb2-81c5-a09c935dd5ff tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:43:04.800882 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-94d14ef7-e291-4fb2-81c5-a09c935dd5ff tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:43:05.093058 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-94d14ef7-e291-4fb2-81c5-a09c935dd5ff tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] 10.222.0.65 "POST /compute/v2.1/servers/c9b67820-7cf5-4a53-9394-c967b6fc2975/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.307262 May 19 21:43:05.093673 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 450/912] 10.222.0.65 () {60 vars in 1322 bytes} [Thu May 19 21:43:04 2022] POST /compute/v2.1/servers/c9b67820-7cf5-4a53-9394-c967b6fc2975/os-volume_attachments => generated 194 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 21:43:12.618520 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-e4172302-79cb-4fd3-a30f-76ca74540ecc tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:43:12.619527 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-e4172302-79cb-4fd3-a30f-76ca74540ecc tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] [instance: c9b67820-7cf5-4a53-9394-c967b6fc2975] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:43:12.626700 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e4172302-79cb-4fd3-a30f-76ca74540ecc tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:43:12.627134 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e4172302-79cb-4fd3-a30f-76ca74540ecc tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:43:12.627898 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e4172302-79cb-4fd3-a30f-76ca74540ecc tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:43:12.628363 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e4172302-79cb-4fd3-a30f-76ca74540ecc tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:43:12.662368 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-e4172302-79cb-4fd3-a30f-76ca74540ecc tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] 10.222.0.65 "GET /compute/v2.1/servers/c9b67820-7cf5-4a53-9394-c967b6fc2975/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.048036 May 19 21:43:12.662957 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 463/913] 10.222.0.65 () {58 vars in 1301 bytes} [Thu May 19 21:43:12 2022] GET /compute/v2.1/servers/c9b67820-7cf5-4a53-9394-c967b6fc2975/os-volume_attachments => generated 371 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 21:43:12.805407 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-bf464f2e-22cd-4159-9ccf-805ac34283d8 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:43:12.806034 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-bf464f2e-22cd-4159-9ccf-805ac34283d8 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] [instance: c9b67820-7cf5-4a53-9394-c967b6fc2975] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:43:12.813558 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-bf464f2e-22cd-4159-9ccf-805ac34283d8 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:43:12.814015 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-bf464f2e-22cd-4159-9ccf-805ac34283d8 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:43:12.814833 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-bf464f2e-22cd-4159-9ccf-805ac34283d8 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:43:12.815268 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-bf464f2e-22cd-4159-9ccf-805ac34283d8 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:43:12.818278 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:43:12.852953 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-bf464f2e-22cd-4159-9ccf-805ac34283d8 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] 10.222.0.65 "GET /compute/v2.1/servers/c9b67820-7cf5-4a53-9394-c967b6fc2975/os-volume_attachments/87b0fa4b-97e0-4509-bb42-42a2a53f2314" status: 200 len: 194 microversion: 2.1 time: 0.052558 May 19 21:43:12.853595 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 451/914] 10.222.0.65 () {58 vars in 1412 bytes} [Thu May 19 21:43:12 2022] GET /compute/v2.1/servers/c9b67820-7cf5-4a53-9394-c967b6fc2975/os-volume_attachments/87b0fa4b-97e0-4509-bb42-42a2a53f2314 => generated 194 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 21:43:12.863731 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-2a3ebf7b-25bd-4766-9ca3-0ae7f7b105b6 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:43:12.864282 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-2a3ebf7b-25bd-4766-9ca3-0ae7f7b105b6 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] [instance: c9b67820-7cf5-4a53-9394-c967b6fc2975] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:43:12.870795 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2a3ebf7b-25bd-4766-9ca3-0ae7f7b105b6 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:43:12.871241 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2a3ebf7b-25bd-4766-9ca3-0ae7f7b105b6 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:43:12.872009 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2a3ebf7b-25bd-4766-9ca3-0ae7f7b105b6 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:43:12.872441 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2a3ebf7b-25bd-4766-9ca3-0ae7f7b105b6 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:43:12.961536 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.objects.instance [None req-2a3ebf7b-25bd-4766-9ca3-0ae7f7b105b6 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lazy-loading 'services' on Instance uuid c9b67820-7cf5-4a53-9394-c967b6fc2975 {{(pid=124350) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 21:43:13.083552 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-2a3ebf7b-25bd-4766-9ca3-0ae7f7b105b6 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] 10.222.0.65 "DELETE /compute/v2.1/servers/c9b67820-7cf5-4a53-9394-c967b6fc2975/os-volume_attachments/87b0fa4b-97e0-4509-bb42-42a2a53f2314" status: 202 len: 0 microversion: 2.1 time: 0.223877 May 19 21:43:13.084183 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 464/915] 10.222.0.65 () {58 vars in 1415 bytes} [Thu May 19 21:43:12 2022] DELETE /compute/v2.1/servers/c9b67820-7cf5-4a53-9394-c967b6fc2975/os-volume_attachments/87b0fa4b-97e0-4509-bb42-42a2a53f2314 => generated 0 bytes in 225 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 21:43:15.268259 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-089ee49c-c4c0-4680-8a35-3bd0f9b17e9b tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:43:15.268843 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-089ee49c-c4c0-4680-8a35-3bd0f9b17e9b tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] [instance: c9b67820-7cf5-4a53-9394-c967b6fc2975] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:43:15.276188 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-089ee49c-c4c0-4680-8a35-3bd0f9b17e9b tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:43:15.276632 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-089ee49c-c4c0-4680-8a35-3bd0f9b17e9b tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:43:15.277412 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-089ee49c-c4c0-4680-8a35-3bd0f9b17e9b tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:43:15.277842 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-089ee49c-c4c0-4680-8a35-3bd0f9b17e9b tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:43:15.308507 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-089ee49c-c4c0-4680-8a35-3bd0f9b17e9b tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] 10.222.0.65 "GET /compute/v2.1/servers/c9b67820-7cf5-4a53-9394-c967b6fc2975/os-volume_attachments/36e7451e-e453-4320-9d81-c38d48d6219b" status: 200 len: 194 microversion: 2.1 time: 0.044324 May 19 21:43:15.309106 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 452/916] 10.222.0.65 () {58 vars in 1412 bytes} [Thu May 19 21:43:15 2022] GET /compute/v2.1/servers/c9b67820-7cf5-4a53-9394-c967b6fc2975/os-volume_attachments/36e7451e-e453-4320-9d81-c38d48d6219b => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 21:43:15.320579 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-9c1df189-3920-4883-8491-5d1b1e2df5b6 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:43:15.321212 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-9c1df189-3920-4883-8491-5d1b1e2df5b6 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] [instance: c9b67820-7cf5-4a53-9394-c967b6fc2975] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:43:15.328295 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9c1df189-3920-4883-8491-5d1b1e2df5b6 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:43:15.328783 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9c1df189-3920-4883-8491-5d1b1e2df5b6 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:43:15.329728 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9c1df189-3920-4883-8491-5d1b1e2df5b6 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:43:15.330162 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9c1df189-3920-4883-8491-5d1b1e2df5b6 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:43:15.418455 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.objects.instance [None req-9c1df189-3920-4883-8491-5d1b1e2df5b6 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lazy-loading 'services' on Instance uuid c9b67820-7cf5-4a53-9394-c967b6fc2975 {{(pid=124350) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 21:43:15.495453 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-9c1df189-3920-4883-8491-5d1b1e2df5b6 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] 10.222.0.65 "DELETE /compute/v2.1/servers/c9b67820-7cf5-4a53-9394-c967b6fc2975/os-volume_attachments/36e7451e-e453-4320-9d81-c38d48d6219b" status: 202 len: 0 microversion: 2.1 time: 0.179589 May 19 21:43:15.496084 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 465/917] 10.222.0.65 () {58 vars in 1415 bytes} [Thu May 19 21:43:15 2022] DELETE /compute/v2.1/servers/c9b67820-7cf5-4a53-9394-c967b6fc2975/os-volume_attachments/36e7451e-e453-4320-9d81-c38d48d6219b => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 21:43:16.672155 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-52c67f7d-8eeb-4b2a-9898-61a5c600230f tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:43:16.673379 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-52c67f7d-8eeb-4b2a-9898-61a5c600230f tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] [instance: c9b67820-7cf5-4a53-9394-c967b6fc2975] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:43:16.680782 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-52c67f7d-8eeb-4b2a-9898-61a5c600230f tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:43:16.681221 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-52c67f7d-8eeb-4b2a-9898-61a5c600230f tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:43:16.682004 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-52c67f7d-8eeb-4b2a-9898-61a5c600230f tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:43:16.682481 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-52c67f7d-8eeb-4b2a-9898-61a5c600230f tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:43:16.714410 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-52c67f7d-8eeb-4b2a-9898-61a5c600230f tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] 10.222.0.65 "GET /compute/v2.1/servers/c9b67820-7cf5-4a53-9394-c967b6fc2975/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047685 May 19 21:43:16.714992 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 453/918] 10.222.0.65 () {58 vars in 1301 bytes} [Thu May 19 21:43:16 2022] GET /compute/v2.1/servers/c9b67820-7cf5-4a53-9394-c967b6fc2975/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 21:43:16.834531 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-69fcb21a-458b-40df-a37a-be31e78c24d1 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:43:16.835556 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-69fcb21a-458b-40df-a37a-be31e78c24d1 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] [instance: c9b67820-7cf5-4a53-9394-c967b6fc2975] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:43:16.842073 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-69fcb21a-458b-40df-a37a-be31e78c24d1 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:43:16.842581 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-69fcb21a-458b-40df-a37a-be31e78c24d1 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:43:16.843345 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-69fcb21a-458b-40df-a37a-be31e78c24d1 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:43:16.843760 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-69fcb21a-458b-40df-a37a-be31e78c24d1 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:43:16.876994 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-69fcb21a-458b-40df-a37a-be31e78c24d1 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] 10.222.0.65 "GET /compute/v2.1/servers/c9b67820-7cf5-4a53-9394-c967b6fc2975/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047314 May 19 21:43:16.877562 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 466/919] 10.222.0.65 () {58 vars in 1301 bytes} [Thu May 19 21:43:16 2022] GET /compute/v2.1/servers/c9b67820-7cf5-4a53-9394-c967b6fc2975/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 21:43:16.944633 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-365f2936-a1e4-4c55-bfca-9a5a6b85969a tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:43:16.945129 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-365f2936-a1e4-4c55-bfca-9a5a6b85969a tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] [instance: c9b67820-7cf5-4a53-9394-c967b6fc2975] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:43:16.952776 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-365f2936-a1e4-4c55-bfca-9a5a6b85969a tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:43:16.953240 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-365f2936-a1e4-4c55-bfca-9a5a6b85969a tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:43:16.954995 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-365f2936-a1e4-4c55-bfca-9a5a6b85969a tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:43:16.954995 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-365f2936-a1e4-4c55-bfca-9a5a6b85969a tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:43:16.987883 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-365f2936-a1e4-4c55-bfca-9a5a6b85969a tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] [instance: c9b67820-7cf5-4a53-9394-c967b6fc2975] Going to try to terminate instance {{(pid=124349) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 21:43:17.083817 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-365f2936-a1e4-4c55-bfca-9a5a6b85969a tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] 10.222.0.65 "DELETE /compute/v2.1/servers/c9b67820-7cf5-4a53-9394-c967b6fc2975" status: 204 len: 0 microversion: 2.1 time: 0.142582 May 19 21:43:17.092659 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 454/920] 10.222.0.65 () {58 vars in 1238 bytes} [Thu May 19 21:43:16 2022] DELETE /compute/v2.1/servers/c9b67820-7cf5-4a53-9394-c967b6fc2975 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 21:43:17.100208 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-04d5090d-2c1a-4f93-8804-21dee9ecb8f1 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:43:17.101350 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-04d5090d-2c1a-4f93-8804-21dee9ecb8f1 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] [instance: c9b67820-7cf5-4a53-9394-c967b6fc2975] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:43:17.119151 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-04d5090d-2c1a-4f93-8804-21dee9ecb8f1 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:43:17.120534 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-04d5090d-2c1a-4f93-8804-21dee9ecb8f1 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:43:17.121911 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-04d5090d-2c1a-4f93-8804-21dee9ecb8f1 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:43:17.122575 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-04d5090d-2c1a-4f93-8804-21dee9ecb8f1 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:43:17.281282 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-04d5090d-2c1a-4f93-8804-21dee9ecb8f1 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d16feb169ac46f7983a6b8045de77c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f5916770e9b443489fe7aa76d663fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:43:17.289572 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-04d5090d-2c1a-4f93-8804-21dee9ecb8f1 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] 10.222.0.65 "GET /compute/v2.1/servers/c9b67820-7cf5-4a53-9394-c967b6fc2975" status: 200 len: 1673 microversion: 2.1 time: 0.194041 May 19 21:43:17.290168 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 467/921] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:43:17 2022] GET /compute/v2.1/servers/c9b67820-7cf5-4a53-9394-c967b6fc2975 => generated 1673 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:43:18.308199 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-d95d2769-bb44-42f6-be99-fa4a955e53df tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:43:18.308806 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-d95d2769-bb44-42f6-be99-fa4a955e53df tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] [instance: c9b67820-7cf5-4a53-9394-c967b6fc2975] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:43:18.316998 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-d95d2769-bb44-42f6-be99-fa4a955e53df tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:43:18.317447 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-d95d2769-bb44-42f6-be99-fa4a955e53df tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:43:18.318271 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-d95d2769-bb44-42f6-be99-fa4a955e53df tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:43:18.318699 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-d95d2769-bb44-42f6-be99-fa4a955e53df tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:43:18.467383 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-d95d2769-bb44-42f6-be99-fa4a955e53df tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d16feb169ac46f7983a6b8045de77c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f5916770e9b443489fe7aa76d663fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:43:18.475321 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-d95d2769-bb44-42f6-be99-fa4a955e53df tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] 10.222.0.65 "GET /compute/v2.1/servers/c9b67820-7cf5-4a53-9394-c967b6fc2975" status: 200 len: 1673 microversion: 2.1 time: 0.171633 May 19 21:43:18.475903 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 455/922] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:43:18 2022] GET /compute/v2.1/servers/c9b67820-7cf5-4a53-9394-c967b6fc2975 => generated 1673 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:43:19.494974 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-cd4f404f-8052-44cf-99ca-a98a32e060b6 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:43:19.495987 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-cd4f404f-8052-44cf-99ca-a98a32e060b6 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] [instance: c9b67820-7cf5-4a53-9394-c967b6fc2975] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:43:19.508365 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cd4f404f-8052-44cf-99ca-a98a32e060b6 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:43:19.509109 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cd4f404f-8052-44cf-99ca-a98a32e060b6 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:43:19.510475 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cd4f404f-8052-44cf-99ca-a98a32e060b6 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:43:19.511204 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cd4f404f-8052-44cf-99ca-a98a32e060b6 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:43:19.731653 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-cd4f404f-8052-44cf-99ca-a98a32e060b6 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d16feb169ac46f7983a6b8045de77c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f5916770e9b443489fe7aa76d663fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:43:19.740099 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-cd4f404f-8052-44cf-99ca-a98a32e060b6 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] 10.222.0.65 "GET /compute/v2.1/servers/c9b67820-7cf5-4a53-9394-c967b6fc2975" status: 200 len: 1673 microversion: 2.1 time: 0.250629 May 19 21:43:19.740660 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 468/923] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:43:19 2022] GET /compute/v2.1/servers/c9b67820-7cf5-4a53-9394-c967b6fc2975 => generated 1673 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:43:20.498703 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [req-7f05090b-0d80-4557-ad98-df3d76c5ae44 req-031deebf-7812-4be2-b101-b3f0f652afcc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9b67820-7cf5-4a53-9394-c967b6fc2975", "name": "network-vif-deleted", "tag": "aaef1770-d4d0-45c5-a159-84af9d8f2b97"}]} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:43:20.508056 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-7f05090b-0d80-4557-ad98-df3d76c5ae44 req-031deebf-7812-4be2-b101-b3f0f652afcc service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:43:20.508535 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-7f05090b-0d80-4557-ad98-df3d76c5ae44 req-031deebf-7812-4be2-b101-b3f0f652afcc service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:43:20.523142 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.compute.server_external_events [req-7f05090b-0d80-4557-ad98-df3d76c5ae44 req-031deebf-7812-4be2-b101-b3f0f652afcc service nova] Creating event network-vif-deleted:aaef1770-d4d0-45c5-a159-84af9d8f2b97 for instance c9b67820-7cf5-4a53-9394-c967b6fc2975 on hv-cinder-83563 May 19 21:43:20.528769 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [req-7f05090b-0d80-4557-ad98-df3d76c5ae44 req-031deebf-7812-4be2-b101-b3f0f652afcc service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033609 May 19 21:43:20.529389 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 456/924] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 21:43:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 21:43:20.757415 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-c79f9234-2289-413c-8d2e-52904933088b tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:43:20.758042 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-c79f9234-2289-413c-8d2e-52904933088b tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] [instance: c9b67820-7cf5-4a53-9394-c967b6fc2975] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:43:20.765398 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c79f9234-2289-413c-8d2e-52904933088b tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:43:20.766069 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c79f9234-2289-413c-8d2e-52904933088b tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:43:20.767178 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c79f9234-2289-413c-8d2e-52904933088b tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:43:20.767965 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c79f9234-2289-413c-8d2e-52904933088b tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:43:20.802202 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c79f9234-2289-413c-8d2e-52904933088b tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:43:20.802672 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c79f9234-2289-413c-8d2e-52904933088b tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:43:20.803112 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.objects.instance [None req-c79f9234-2289-413c-8d2e-52904933088b tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lazy-loading 'fault' on Instance uuid c9b67820-7cf5-4a53-9394-c967b6fc2975 {{(pid=124350) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 21:43:20.847422 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-c79f9234-2289-413c-8d2e-52904933088b tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d16feb169ac46f7983a6b8045de77c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f5916770e9b443489fe7aa76d663fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:43:20.856914 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-c79f9234-2289-413c-8d2e-52904933088b tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] 10.222.0.65 "GET /compute/v2.1/servers/c9b67820-7cf5-4a53-9394-c967b6fc2975" status: 200 len: 1327 microversion: 2.1 time: 0.103457 May 19 21:43:20.857518 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 469/925] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:43:20 2022] GET /compute/v2.1/servers/c9b67820-7cf5-4a53-9394-c967b6fc2975 => generated 1327 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:43:21.878343 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-f7759d88-93c2-4d66-8952-e946d750ebde tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:43:21.879035 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-f7759d88-93c2-4d66-8952-e946d750ebde tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] [instance: c9b67820-7cf5-4a53-9394-c967b6fc2975] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:43:21.885787 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f7759d88-93c2-4d66-8952-e946d750ebde tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:43:21.886256 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f7759d88-93c2-4d66-8952-e946d750ebde tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:43:21.887097 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f7759d88-93c2-4d66-8952-e946d750ebde tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:43:21.887528 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f7759d88-93c2-4d66-8952-e946d750ebde tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:43:21.903202 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.wsgi [None req-f7759d88-93c2-4d66-8952-e946d750ebde tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] HTTP exception thrown: Instance c9b67820-7cf5-4a53-9394-c967b6fc2975 could not be found. May 19 21:43:21.904841 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-f7759d88-93c2-4d66-8952-e946d750ebde tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Request method failure captured: May 19 21:43:21.904841 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: request: GET /compute/v2.1/servers/c9b67820-7cf5-4a53-9394-c967b6fc2975 HTTP/1.1 May 19 21:43:21.904841 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Accept: application/json May 19 21:43:21.904841 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Accept-Encoding: identity May 19 21:43:21.904841 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Connection: close May 19 21:43:21.904841 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Content-Length: 0 May 19 21:43:21.904841 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Content-Type: application/json May 19 21:43:21.904841 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Host: 10.222.0.65 May 19 21:43:21.904841 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Openstack-System-Scope: None May 19 21:43:21.904841 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: User-Agent: python-urllib3/1.26.9 May 19 21:43:21.904841 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Auth-Token: gAAAAABihrdzwR9cl0_mageJowPPL0-Y3i1KMeew291MevSsvOTqUH9T6iei7uUBsOAIGU3BxH7b0q7g-iljM23fwskHFTiOtCziTY8T_e9-kcByALEKSIs2xltqad-aPdSyLrfb94hwo3vsyNxq18OAoSEk237HODw0VQ0Y-RzjZzfZF7bi2Oo May 19 21:43:21.904841 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Domain-Id: None May 19 21:43:21.904841 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Domain-Name: None May 19 21:43:21.904841 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Identity-Status: Confirmed May 19 21:43:21.904841 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Is-Admin-Project: True May 19 21:43:21.904841 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Project-Domain-Id: default May 19 21:43:21.904841 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Project-Domain-Name: Default May 19 21:43:21.904841 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Project-Id: 4f5916770e9b443489fe7aa76d663fe1 May 19 21:43:21.904841 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Project-Name: tempest-AttachVolumeTestJSON-1629354560 May 19 21:43:21.904841 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Role: reader,member May 19 21:43:21.904841 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Roles: reader,member May 19 21:43:21.907130 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/4f5916770e9b443489fe7aa76d663fe1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/4f5916770e9b443489fe7aa76d663fe1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_4f5916770e9b443489fe7aa76d663fe1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/4f5916770e9b443489fe7aa76d663fe1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}] May 19 21:43:21.907130 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Tenant: tempest-AttachVolumeTestJSON-1629354560 May 19 21:43:21.907130 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Tenant-Id: 4f5916770e9b443489fe7aa76d663fe1 May 19 21:43:21.907130 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1629354560 May 19 21:43:21.907130 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-User: tempest-AttachVolumeTestJSON-1629354560-project May 19 21:43:21.907130 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-User-Domain-Id: default May 19 21:43:21.907130 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-User-Domain-Name: Default May 19 21:43:21.907130 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-User-Id: 6d16feb169ac46f7983a6b8045de77c9 May 19 21:43:21.907130 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-User-Name: tempest-AttachVolumeTestJSON-1629354560-project May 19 21:43:21.907130 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: method: > May 19 21:43:21.907130 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: exception: Instance c9b67820-7cf5-4a53-9394-c967b6fc2975 could not be found. May 19 21:43:21.907130 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: action_args: {'id': 'c9b67820-7cf5-4a53-9394-c967b6fc2975'} May 19 21:43:21.908145 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 21:43:21.908145 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:43:21.908145 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 21:43:21.908145 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 21:43:21.908145 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 21:43:21.908145 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 21:43:21.908145 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 21:43:21.908145 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 21:43:21.908145 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 21:43:21.908145 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 21:43:21.908145 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9b67820-7cf5-4a53-9394-c967b6fc2975 could not be found. May 19 21:43:21.908145 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:43:21.908145 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 21:43:21.908145 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:43:21.908145 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:43:21.908145 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 21:43:21.908145 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 21:43:21.908145 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 21:43:21.908145 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 21:43:21.908145 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 21:43:21.909688 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 21:43:21.909688 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 21:43:21.909688 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 21:43:21.909688 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 21:43:21.909688 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 21:43:21.909688 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 21:43:21.909688 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 21:43:21.909688 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9b67820-7cf5-4a53-9394-c967b6fc2975 could not be found. May 19 21:43:21.909688 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:43:21.909688 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 21:43:21.909688 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:43:21.909688 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:43:21.909688 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 21:43:21.909688 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 21:43:21.909688 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 21:43:21.909688 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 21:43:21.909688 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9b67820-7cf5-4a53-9394-c967b6fc2975 could not be found. May 19 21:43:21.909688 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:43:21.911033 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-f7759d88-93c2-4d66-8952-e946d750ebde tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Returning 404 to user: Instance c9b67820-7cf5-4a53-9394-c967b6fc2975 could not be found. {{(pid=124349) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 21:43:21.911033 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-f7759d88-93c2-4d66-8952-e946d750ebde tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] 10.222.0.65 "GET /compute/v2.1/servers/c9b67820-7cf5-4a53-9394-c967b6fc2975" status: 404 len: 111 microversion: 2.1 time: 0.034287 May 19 21:43:21.911033 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 457/926] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:43:21 2022] GET /compute/v2.1/servers/c9b67820-7cf5-4a53-9394-c967b6fc2975 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 21:43:21.917761 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-784ee26f-e7c4-4de5-8319-6f5add6b70db tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Calling method '.version_select at 0x7fe363750a60>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:43:21.945192 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-784ee26f-e7c4-4de5-8319-6f5add6b70db tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1307304629" status: 202 len: 0 microversion: 2.1 time: 0.033493 May 19 21:43:21.945747 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 470/927] 10.222.0.65 () {58 vars in 1220 bytes} [Thu May 19 21:43:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1307304629 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 21:43:24.954662 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-73db99f3-7ff3-4062-9a65-ecc4fd7bf6ce tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:43:24.955198 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-73db99f3-7ff3-4062-9a65-ecc4fd7bf6ce tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] [instance: c9b67820-7cf5-4a53-9394-c967b6fc2975] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:43:24.957598 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_api:SELECT=25,nova_api:UPDATE=1 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:43:24.963300 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-73db99f3-7ff3-4062-9a65-ecc4fd7bf6ce tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:43:24.963747 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-73db99f3-7ff3-4062-9a65-ecc4fd7bf6ce tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:43:24.964512 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-73db99f3-7ff3-4062-9a65-ecc4fd7bf6ce tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:43:24.964945 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-73db99f3-7ff3-4062-9a65-ecc4fd7bf6ce tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:43:24.980072 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.wsgi [None req-73db99f3-7ff3-4062-9a65-ecc4fd7bf6ce tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] HTTP exception thrown: Instance c9b67820-7cf5-4a53-9394-c967b6fc2975 could not be found. May 19 21:43:24.981693 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-73db99f3-7ff3-4062-9a65-ecc4fd7bf6ce tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Request method failure captured: May 19 21:43:24.981693 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: request: DELETE /compute/v2.1/servers/c9b67820-7cf5-4a53-9394-c967b6fc2975 HTTP/1.1 May 19 21:43:24.981693 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Accept: application/json May 19 21:43:24.981693 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Accept-Encoding: identity May 19 21:43:24.981693 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Connection: close May 19 21:43:24.981693 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Content-Length: 0 May 19 21:43:24.981693 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Content-Type: application/json May 19 21:43:24.981693 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Host: 10.222.0.65 May 19 21:43:24.981693 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Openstack-System-Scope: None May 19 21:43:24.981693 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: User-Agent: python-urllib3/1.26.9 May 19 21:43:24.981693 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Auth-Token: gAAAAABihrdzwR9cl0_mageJowPPL0-Y3i1KMeew291MevSsvOTqUH9T6iei7uUBsOAIGU3BxH7b0q7g-iljM23fwskHFTiOtCziTY8T_e9-kcByALEKSIs2xltqad-aPdSyLrfb94hwo3vsyNxq18OAoSEk237HODw0VQ0Y-RzjZzfZF7bi2Oo May 19 21:43:24.981693 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Domain-Id: None May 19 21:43:24.981693 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Domain-Name: None May 19 21:43:24.981693 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Identity-Status: Confirmed May 19 21:43:24.981693 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Is-Admin-Project: True May 19 21:43:24.981693 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Project-Domain-Id: default May 19 21:43:24.981693 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Project-Domain-Name: Default May 19 21:43:24.981693 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Project-Id: 4f5916770e9b443489fe7aa76d663fe1 May 19 21:43:24.981693 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Project-Name: tempest-AttachVolumeTestJSON-1629354560 May 19 21:43:24.981693 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Role: reader,member May 19 21:43:24.981693 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Roles: reader,member May 19 21:43:24.983131 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/4f5916770e9b443489fe7aa76d663fe1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/4f5916770e9b443489fe7aa76d663fe1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_4f5916770e9b443489fe7aa76d663fe1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/4f5916770e9b443489fe7aa76d663fe1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}] May 19 21:43:24.983131 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Tenant: tempest-AttachVolumeTestJSON-1629354560 May 19 21:43:24.983131 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Tenant-Id: 4f5916770e9b443489fe7aa76d663fe1 May 19 21:43:24.983131 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1629354560 May 19 21:43:24.983131 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-User: tempest-AttachVolumeTestJSON-1629354560-project May 19 21:43:24.983131 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-User-Domain-Id: default May 19 21:43:24.983131 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-User-Domain-Name: Default May 19 21:43:24.983131 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-User-Id: 6d16feb169ac46f7983a6b8045de77c9 May 19 21:43:24.983131 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-User-Name: tempest-AttachVolumeTestJSON-1629354560-project May 19 21:43:24.983131 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: method: > May 19 21:43:24.983131 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: exception: Instance c9b67820-7cf5-4a53-9394-c967b6fc2975 could not be found. May 19 21:43:24.983131 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: action_args: {'id': 'c9b67820-7cf5-4a53-9394-c967b6fc2975'} May 19 21:43:24.983873 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 21:43:24.983873 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:43:24.983873 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 21:43:24.983873 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 21:43:24.983873 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 21:43:24.983873 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 21:43:24.983873 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 21:43:24.983873 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 21:43:24.983873 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 21:43:24.983873 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 21:43:24.983873 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9b67820-7cf5-4a53-9394-c967b6fc2975 could not be found. May 19 21:43:24.983873 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:43:24.983873 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 21:43:24.983873 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:43:24.983873 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:43:24.983873 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 21:43:24.983873 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 21:43:24.983873 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 21:43:24.983873 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 21:43:24.983873 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 21:43:24.985795 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 21:43:24.985795 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 19 21:43:24.985795 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 21:43:24.985795 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 19 21:43:24.985795 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 21:43:24.985795 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 21:43:24.985795 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 21:43:24.985795 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 21:43:24.985795 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 21:43:24.985795 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9b67820-7cf5-4a53-9394-c967b6fc2975 could not be found. May 19 21:43:24.985795 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:43:24.985795 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 21:43:24.985795 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:43:24.985795 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:43:24.985795 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 21:43:24.985795 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 21:43:24.985795 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 21:43:24.985795 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 21:43:24.985795 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9b67820-7cf5-4a53-9394-c967b6fc2975 could not be found. May 19 21:43:24.985795 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:43:24.987390 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-73db99f3-7ff3-4062-9a65-ecc4fd7bf6ce tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Returning 404 to user: Instance c9b67820-7cf5-4a53-9394-c967b6fc2975 could not be found. {{(pid=124349) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 21:43:24.987390 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-73db99f3-7ff3-4062-9a65-ecc4fd7bf6ce tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] 10.222.0.65 "DELETE /compute/v2.1/servers/c9b67820-7cf5-4a53-9394-c967b6fc2975" status: 404 len: 111 microversion: 2.1 time: 0.032373 May 19 21:43:24.987390 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 458/928] 10.222.0.65 () {58 vars in 1238 bytes} [Thu May 19 21:43:24 2022] DELETE /compute/v2.1/servers/c9b67820-7cf5-4a53-9394-c967b6fc2975 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 21:43:24.993327 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-92ece4eb-b026-41a4-a559-c8b622390439 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:43:24.993933 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-92ece4eb-b026-41a4-a559-c8b622390439 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] [instance: c9b67820-7cf5-4a53-9394-c967b6fc2975] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:43:25.001709 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-92ece4eb-b026-41a4-a559-c8b622390439 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:43:25.002159 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-92ece4eb-b026-41a4-a559-c8b622390439 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:43:25.002954 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-92ece4eb-b026-41a4-a559-c8b622390439 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:43:25.003386 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-92ece4eb-b026-41a4-a559-c8b622390439 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:43:25.018264 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.wsgi [None req-92ece4eb-b026-41a4-a559-c8b622390439 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] HTTP exception thrown: Instance c9b67820-7cf5-4a53-9394-c967b6fc2975 could not be found. May 19 21:43:25.020136 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-92ece4eb-b026-41a4-a559-c8b622390439 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Request method failure captured: May 19 21:43:25.020136 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: request: GET /compute/v2.1/servers/c9b67820-7cf5-4a53-9394-c967b6fc2975 HTTP/1.1 May 19 21:43:25.020136 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Accept: application/json May 19 21:43:25.020136 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Accept-Encoding: identity May 19 21:43:25.020136 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Connection: close May 19 21:43:25.020136 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Content-Length: 0 May 19 21:43:25.020136 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Content-Type: application/json May 19 21:43:25.020136 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Host: 10.222.0.65 May 19 21:43:25.020136 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Openstack-System-Scope: None May 19 21:43:25.020136 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: User-Agent: python-urllib3/1.26.9 May 19 21:43:25.020136 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Auth-Token: gAAAAABihrdzwR9cl0_mageJowPPL0-Y3i1KMeew291MevSsvOTqUH9T6iei7uUBsOAIGU3BxH7b0q7g-iljM23fwskHFTiOtCziTY8T_e9-kcByALEKSIs2xltqad-aPdSyLrfb94hwo3vsyNxq18OAoSEk237HODw0VQ0Y-RzjZzfZF7bi2Oo May 19 21:43:25.020136 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Domain-Id: None May 19 21:43:25.020136 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Domain-Name: None May 19 21:43:25.020136 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Identity-Status: Confirmed May 19 21:43:25.020136 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Is-Admin-Project: True May 19 21:43:25.020136 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Project-Domain-Id: default May 19 21:43:25.020136 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Project-Domain-Name: Default May 19 21:43:25.020136 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Project-Id: 4f5916770e9b443489fe7aa76d663fe1 May 19 21:43:25.020136 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Project-Name: tempest-AttachVolumeTestJSON-1629354560 May 19 21:43:25.020136 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Role: reader,member May 19 21:43:25.020136 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Roles: reader,member May 19 21:43:25.021659 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/4f5916770e9b443489fe7aa76d663fe1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/4f5916770e9b443489fe7aa76d663fe1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_4f5916770e9b443489fe7aa76d663fe1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/4f5916770e9b443489fe7aa76d663fe1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}] May 19 21:43:25.021659 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Tenant: tempest-AttachVolumeTestJSON-1629354560 May 19 21:43:25.021659 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Tenant-Id: 4f5916770e9b443489fe7aa76d663fe1 May 19 21:43:25.021659 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1629354560 May 19 21:43:25.021659 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-User: tempest-AttachVolumeTestJSON-1629354560-project May 19 21:43:25.021659 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-User-Domain-Id: default May 19 21:43:25.021659 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-User-Domain-Name: Default May 19 21:43:25.021659 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-User-Id: 6d16feb169ac46f7983a6b8045de77c9 May 19 21:43:25.021659 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-User-Name: tempest-AttachVolumeTestJSON-1629354560-project May 19 21:43:25.021659 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: method: > May 19 21:43:25.021659 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: exception: Instance c9b67820-7cf5-4a53-9394-c967b6fc2975 could not be found. May 19 21:43:25.021659 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: action_args: {'id': 'c9b67820-7cf5-4a53-9394-c967b6fc2975'} May 19 21:43:25.022733 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 21:43:25.022733 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:43:25.022733 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 21:43:25.022733 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 21:43:25.022733 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 21:43:25.022733 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 21:43:25.022733 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 21:43:25.022733 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 21:43:25.022733 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 21:43:25.022733 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 21:43:25.022733 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9b67820-7cf5-4a53-9394-c967b6fc2975 could not be found. May 19 21:43:25.022733 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi May 19 21:43:25.022733 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 21:43:25.022733 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi May 19 21:43:25.022733 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:43:25.022733 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 21:43:25.022733 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 21:43:25.022733 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 21:43:25.022733 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 21:43:25.022733 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 21:43:25.023998 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 21:43:25.023998 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 21:43:25.023998 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 21:43:25.023998 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 21:43:25.023998 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 21:43:25.023998 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 21:43:25.023998 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 21:43:25.023998 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9b67820-7cf5-4a53-9394-c967b6fc2975 could not be found. May 19 21:43:25.023998 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi May 19 21:43:25.023998 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 21:43:25.023998 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi May 19 21:43:25.023998 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:43:25.023998 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 21:43:25.023998 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 21:43:25.023998 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 21:43:25.023998 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 21:43:25.023998 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9b67820-7cf5-4a53-9394-c967b6fc2975 could not be found. May 19 21:43:25.023998 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi May 19 21:43:25.025058 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-92ece4eb-b026-41a4-a559-c8b622390439 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Returning 404 to user: Instance c9b67820-7cf5-4a53-9394-c967b6fc2975 could not be found. {{(pid=124350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 21:43:25.025058 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-92ece4eb-b026-41a4-a559-c8b622390439 tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] 10.222.0.65 "GET /compute/v2.1/servers/c9b67820-7cf5-4a53-9394-c967b6fc2975" status: 404 len: 111 microversion: 2.1 time: 0.033186 May 19 21:43:25.025058 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 471/929] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:43:24 2022] GET /compute/v2.1/servers/c9b67820-7cf5-4a53-9394-c967b6fc2975 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 21:43:26.170630 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-7817c565-c02c-4a1b-9581-2ae31640621a tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:43:26.171232 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-7817c565-c02c-4a1b-9581-2ae31640621a tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] [instance: a392a14d-152c-467f-8031-a4bb8e36e5bb] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:43:26.178672 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-7817c565-c02c-4a1b-9581-2ae31640621a tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:43:26.179158 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-7817c565-c02c-4a1b-9581-2ae31640621a tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:43:26.180001 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-7817c565-c02c-4a1b-9581-2ae31640621a tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:43:26.180588 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-7817c565-c02c-4a1b-9581-2ae31640621a tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:43:26.197157 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.wsgi [None req-7817c565-c02c-4a1b-9581-2ae31640621a tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] HTTP exception thrown: Instance a392a14d-152c-467f-8031-a4bb8e36e5bb could not be found. May 19 21:43:26.198818 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-7817c565-c02c-4a1b-9581-2ae31640621a tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Request method failure captured: May 19 21:43:26.198818 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: request: DELETE /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb HTTP/1.1 May 19 21:43:26.198818 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Accept: application/json May 19 21:43:26.198818 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Accept-Encoding: identity May 19 21:43:26.198818 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Connection: close May 19 21:43:26.198818 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Content-Length: 0 May 19 21:43:26.198818 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Content-Type: application/json May 19 21:43:26.198818 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Host: 10.222.0.65 May 19 21:43:26.198818 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Openstack-System-Scope: None May 19 21:43:26.198818 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: User-Agent: python-urllib3/1.26.9 May 19 21:43:26.198818 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Auth-Token: gAAAAABihrdzwR9cl0_mageJowPPL0-Y3i1KMeew291MevSsvOTqUH9T6iei7uUBsOAIGU3BxH7b0q7g-iljM23fwskHFTiOtCziTY8T_e9-kcByALEKSIs2xltqad-aPdSyLrfb94hwo3vsyNxq18OAoSEk237HODw0VQ0Y-RzjZzfZF7bi2Oo May 19 21:43:26.198818 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Domain-Id: None May 19 21:43:26.198818 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Domain-Name: None May 19 21:43:26.198818 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Identity-Status: Confirmed May 19 21:43:26.198818 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Is-Admin-Project: True May 19 21:43:26.198818 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Project-Domain-Id: default May 19 21:43:26.198818 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Project-Domain-Name: Default May 19 21:43:26.198818 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Project-Id: 4f5916770e9b443489fe7aa76d663fe1 May 19 21:43:26.198818 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Project-Name: tempest-AttachVolumeTestJSON-1629354560 May 19 21:43:26.198818 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Role: reader,member May 19 21:43:26.198818 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Roles: reader,member May 19 21:43:26.200555 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/4f5916770e9b443489fe7aa76d663fe1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/4f5916770e9b443489fe7aa76d663fe1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_4f5916770e9b443489fe7aa76d663fe1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/4f5916770e9b443489fe7aa76d663fe1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}] May 19 21:43:26.200555 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Tenant: tempest-AttachVolumeTestJSON-1629354560 May 19 21:43:26.200555 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Tenant-Id: 4f5916770e9b443489fe7aa76d663fe1 May 19 21:43:26.200555 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1629354560 May 19 21:43:26.200555 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-User: tempest-AttachVolumeTestJSON-1629354560-project May 19 21:43:26.200555 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-User-Domain-Id: default May 19 21:43:26.200555 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-User-Domain-Name: Default May 19 21:43:26.200555 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-User-Id: 6d16feb169ac46f7983a6b8045de77c9 May 19 21:43:26.200555 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-User-Name: tempest-AttachVolumeTestJSON-1629354560-project May 19 21:43:26.200555 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: method: > May 19 21:43:26.200555 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: exception: Instance a392a14d-152c-467f-8031-a4bb8e36e5bb could not be found. May 19 21:43:26.200555 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: action_args: {'id': 'a392a14d-152c-467f-8031-a4bb8e36e5bb'} May 19 21:43:26.201336 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 21:43:26.201336 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:43:26.201336 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 21:43:26.201336 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 21:43:26.201336 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 21:43:26.201336 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 21:43:26.201336 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 21:43:26.201336 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 21:43:26.201336 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 21:43:26.201336 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 21:43:26.201336 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a392a14d-152c-467f-8031-a4bb8e36e5bb could not be found. May 19 21:43:26.201336 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:43:26.201336 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 21:43:26.201336 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:43:26.201336 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:43:26.201336 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 21:43:26.201336 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 21:43:26.201336 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 21:43:26.201336 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 21:43:26.201336 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 21:43:26.203205 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 21:43:26.203205 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 19 21:43:26.203205 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 21:43:26.203205 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 19 21:43:26.203205 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 21:43:26.203205 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 21:43:26.203205 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 21:43:26.203205 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 21:43:26.203205 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 21:43:26.203205 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a392a14d-152c-467f-8031-a4bb8e36e5bb could not be found. May 19 21:43:26.203205 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:43:26.203205 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 21:43:26.203205 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:43:26.203205 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:43:26.203205 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 21:43:26.203205 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 21:43:26.203205 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 21:43:26.203205 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 21:43:26.203205 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a392a14d-152c-467f-8031-a4bb8e36e5bb could not be found. May 19 21:43:26.203205 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:43:26.204503 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-7817c565-c02c-4a1b-9581-2ae31640621a tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Returning 404 to user: Instance a392a14d-152c-467f-8031-a4bb8e36e5bb could not be found. {{(pid=124349) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 21:43:26.204503 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-7817c565-c02c-4a1b-9581-2ae31640621a tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] 10.222.0.65 "DELETE /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb" status: 404 len: 111 microversion: 2.1 time: 0.034150 May 19 21:43:26.204503 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 459/930] 10.222.0.65 () {58 vars in 1238 bytes} [Thu May 19 21:43:26 2022] DELETE /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 21:43:26.210128 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-27642433-374d-481f-8c8b-62d09e79f54b tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:43:26.210781 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-27642433-374d-481f-8c8b-62d09e79f54b tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] [instance: a392a14d-152c-467f-8031-a4bb8e36e5bb] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:43:26.217531 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-27642433-374d-481f-8c8b-62d09e79f54b tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:43:26.217978 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-27642433-374d-481f-8c8b-62d09e79f54b tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:43:26.218789 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-27642433-374d-481f-8c8b-62d09e79f54b tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:43:26.219220 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-27642433-374d-481f-8c8b-62d09e79f54b tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:43:26.222229 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:43:26.238979 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.wsgi [None req-27642433-374d-481f-8c8b-62d09e79f54b tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] HTTP exception thrown: Instance a392a14d-152c-467f-8031-a4bb8e36e5bb could not be found. May 19 21:43:26.240553 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-27642433-374d-481f-8c8b-62d09e79f54b tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Request method failure captured: May 19 21:43:26.240553 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: request: GET /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb HTTP/1.1 May 19 21:43:26.240553 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Accept: application/json May 19 21:43:26.240553 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Accept-Encoding: identity May 19 21:43:26.240553 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Connection: close May 19 21:43:26.240553 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Content-Length: 0 May 19 21:43:26.240553 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Content-Type: application/json May 19 21:43:26.240553 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Host: 10.222.0.65 May 19 21:43:26.240553 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Openstack-System-Scope: None May 19 21:43:26.240553 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: User-Agent: python-urllib3/1.26.9 May 19 21:43:26.240553 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Auth-Token: gAAAAABihrdzwR9cl0_mageJowPPL0-Y3i1KMeew291MevSsvOTqUH9T6iei7uUBsOAIGU3BxH7b0q7g-iljM23fwskHFTiOtCziTY8T_e9-kcByALEKSIs2xltqad-aPdSyLrfb94hwo3vsyNxq18OAoSEk237HODw0VQ0Y-RzjZzfZF7bi2Oo May 19 21:43:26.240553 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Domain-Id: None May 19 21:43:26.240553 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Domain-Name: None May 19 21:43:26.240553 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Identity-Status: Confirmed May 19 21:43:26.240553 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Is-Admin-Project: True May 19 21:43:26.240553 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Project-Domain-Id: default May 19 21:43:26.240553 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Project-Domain-Name: Default May 19 21:43:26.240553 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Project-Id: 4f5916770e9b443489fe7aa76d663fe1 May 19 21:43:26.240553 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Project-Name: tempest-AttachVolumeTestJSON-1629354560 May 19 21:43:26.240553 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Role: reader,member May 19 21:43:26.240553 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Roles: reader,member May 19 21:43:26.242283 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/4f5916770e9b443489fe7aa76d663fe1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/4f5916770e9b443489fe7aa76d663fe1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_4f5916770e9b443489fe7aa76d663fe1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/4f5916770e9b443489fe7aa76d663fe1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}] May 19 21:43:26.242283 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Tenant: tempest-AttachVolumeTestJSON-1629354560 May 19 21:43:26.242283 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Tenant-Id: 4f5916770e9b443489fe7aa76d663fe1 May 19 21:43:26.242283 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1629354560 May 19 21:43:26.242283 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-User: tempest-AttachVolumeTestJSON-1629354560-project May 19 21:43:26.242283 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-User-Domain-Id: default May 19 21:43:26.242283 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-User-Domain-Name: Default May 19 21:43:26.242283 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-User-Id: 6d16feb169ac46f7983a6b8045de77c9 May 19 21:43:26.242283 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-User-Name: tempest-AttachVolumeTestJSON-1629354560-project May 19 21:43:26.242283 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: method: > May 19 21:43:26.242283 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: exception: Instance a392a14d-152c-467f-8031-a4bb8e36e5bb could not be found. May 19 21:43:26.242283 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: action_args: {'id': 'a392a14d-152c-467f-8031-a4bb8e36e5bb'} May 19 21:43:26.243260 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 21:43:26.243260 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:43:26.243260 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 21:43:26.243260 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 21:43:26.243260 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 21:43:26.243260 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 21:43:26.243260 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 21:43:26.243260 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 21:43:26.243260 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 21:43:26.243260 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 21:43:26.243260 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a392a14d-152c-467f-8031-a4bb8e36e5bb could not be found. May 19 21:43:26.243260 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi May 19 21:43:26.243260 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 21:43:26.243260 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi May 19 21:43:26.243260 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:43:26.243260 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 21:43:26.243260 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 21:43:26.243260 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 21:43:26.243260 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 21:43:26.243260 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 21:43:26.244629 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 21:43:26.244629 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 21:43:26.244629 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 21:43:26.244629 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 21:43:26.244629 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 21:43:26.244629 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 21:43:26.244629 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 21:43:26.244629 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a392a14d-152c-467f-8031-a4bb8e36e5bb could not be found. May 19 21:43:26.244629 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi May 19 21:43:26.244629 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 21:43:26.244629 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi May 19 21:43:26.244629 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:43:26.244629 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 21:43:26.244629 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 21:43:26.244629 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 21:43:26.244629 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 21:43:26.244629 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a392a14d-152c-467f-8031-a4bb8e36e5bb could not be found. May 19 21:43:26.244629 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi May 19 21:43:26.246112 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-27642433-374d-481f-8c8b-62d09e79f54b tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] Returning 404 to user: Instance a392a14d-152c-467f-8031-a4bb8e36e5bb could not be found. {{(pid=124350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 21:43:26.246112 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-27642433-374d-481f-8c8b-62d09e79f54b tempest-AttachVolumeTestJSON-1629354560 tempest-AttachVolumeTestJSON-1629354560-project] 10.222.0.65 "GET /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb" status: 404 len: 111 microversion: 2.1 time: 0.036522 May 19 21:43:26.246112 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 472/931] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:43:26 2022] GET /compute/v2.1/servers/a392a14d-152c-467f-8031-a4bb8e36e5bb => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 21:44:03.759581 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-e42b6710-c7c2-41d0-8e23-572f23b6862c tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:44:03.763823 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-e42b6710-c7c2-41d0-8e23-572f23b6862c tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: 446bb786-0ec7-4542-9509-36282d7126c8] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:44:03.763823 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_api:SELECT=3 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:44:03.763823 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_cell1:SELECT=45,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:44:03.769968 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e42b6710-c7c2-41d0-8e23-572f23b6862c tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:44:03.770510 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e42b6710-c7c2-41d0-8e23-572f23b6862c tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:44:03.771284 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e42b6710-c7c2-41d0-8e23-572f23b6862c tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:44:03.772335 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e42b6710-c7c2-41d0-8e23-572f23b6862c tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:44:03.806572 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-e42b6710-c7c2-41d0-8e23-572f23b6862c tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.051084 May 19 21:44:03.807405 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 460/932] 10.222.0.65 () {60 vars in 1342 bytes} [Thu May 19 21:44:03 2022] GET /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:44:03.894401 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-e903494c-1f40-4b24-b9cb-2b4dbf8728fb tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:44:03.895593 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-e903494c-1f40-4b24-b9cb-2b4dbf8728fb tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: 446bb786-0ec7-4542-9509-36282d7126c8] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:44:03.899455 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_api:SELECT=24,nova_api:DELETE=1 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:44:03.907655 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e903494c-1f40-4b24-b9cb-2b4dbf8728fb tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:44:03.908096 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e903494c-1f40-4b24-b9cb-2b4dbf8728fb tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:44:03.908942 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e903494c-1f40-4b24-b9cb-2b4dbf8728fb tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:44:03.909348 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e903494c-1f40-4b24-b9cb-2b4dbf8728fb tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:44:03.941304 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-e903494c-1f40-4b24-b9cb-2b4dbf8728fb tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: 446bb786-0ec7-4542-9509-36282d7126c8] Going to try to terminate instance {{(pid=124350) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 21:44:04.044459 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-e903494c-1f40-4b24-b9cb-2b4dbf8728fb tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "DELETE /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8" status: 204 len: 0 microversion: 2.20 time: 0.157377 May 19 21:44:04.046314 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 473/933] 10.222.0.65 () {60 vars in 1279 bytes} [Thu May 19 21:44:03 2022] DELETE /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 19 21:44:04.057253 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-8f3a6c27-6ce2-4d75-ace4-0e3682979ce6 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:44:04.058060 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-8f3a6c27-6ce2-4d75-ace4-0e3682979ce6 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: 446bb786-0ec7-4542-9509-36282d7126c8] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:44:04.066215 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-8f3a6c27-6ce2-4d75-ace4-0e3682979ce6 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:44:04.067029 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-8f3a6c27-6ce2-4d75-ace4-0e3682979ce6 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:44:04.067822 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-8f3a6c27-6ce2-4d75-ace4-0e3682979ce6 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:44:04.068255 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-8f3a6c27-6ce2-4d75-ace4-0e3682979ce6 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:44:04.222854 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-8f3a6c27-6ce2-4d75-ace4-0e3682979ce6 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:44:04.231701 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-8f3a6c27-6ce2-4d75-ace4-0e3682979ce6 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:44:04.233258 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-8f3a6c27-6ce2-4d75-ace4-0e3682979ce6 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:44:04.237070 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-8f3a6c27-6ce2-4d75-ace4-0e3682979ce6 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8" status: 200 len: 1724 microversion: 2.20 time: 0.184511 May 19 21:44:04.237678 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 461/934] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:44:04 2022] GET /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8 => generated 1724 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:44:05.260590 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-ae79d0e9-3dc6-4b5a-9ce9-2133f0710d34 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:44:05.262060 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-ae79d0e9-3dc6-4b5a-9ce9-2133f0710d34 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: 446bb786-0ec7-4542-9509-36282d7126c8] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:44:05.271433 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ae79d0e9-3dc6-4b5a-9ce9-2133f0710d34 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:44:05.271887 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ae79d0e9-3dc6-4b5a-9ce9-2133f0710d34 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:44:05.272665 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ae79d0e9-3dc6-4b5a-9ce9-2133f0710d34 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:44:05.273098 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ae79d0e9-3dc6-4b5a-9ce9-2133f0710d34 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:44:05.418771 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-ae79d0e9-3dc6-4b5a-9ce9-2133f0710d34 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:44:05.428328 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-ae79d0e9-3dc6-4b5a-9ce9-2133f0710d34 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:44:05.433301 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-ae79d0e9-3dc6-4b5a-9ce9-2133f0710d34 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:44:05.433301 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-ae79d0e9-3dc6-4b5a-9ce9-2133f0710d34 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8" status: 200 len: 1724 microversion: 2.20 time: 0.179005 May 19 21:44:05.433301 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 474/935] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:44:05 2022] GET /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8 => generated 1724 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:44:06.455088 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-43f72a40-5a06-4f62-b4a6-39df272cdf1a tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:44:06.457106 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-43f72a40-5a06-4f62-b4a6-39df272cdf1a tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: 446bb786-0ec7-4542-9509-36282d7126c8] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:44:06.469904 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-43f72a40-5a06-4f62-b4a6-39df272cdf1a tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:44:06.471139 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-43f72a40-5a06-4f62-b4a6-39df272cdf1a tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:44:06.473766 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-43f72a40-5a06-4f62-b4a6-39df272cdf1a tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:44:06.474558 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-43f72a40-5a06-4f62-b4a6-39df272cdf1a tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:44:06.642768 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-43f72a40-5a06-4f62-b4a6-39df272cdf1a tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:44:06.656805 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-43f72a40-5a06-4f62-b4a6-39df272cdf1a tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:44:06.660107 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-43f72a40-5a06-4f62-b4a6-39df272cdf1a tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f47e7f746a014cb0a35390e7e0ce435d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92434c51e27a405aaa89a70a660f6d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:44:06.662219 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-43f72a40-5a06-4f62-b4a6-39df272cdf1a tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8" status: 200 len: 1724 microversion: 2.20 time: 0.215052 May 19 21:44:06.663933 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 462/936] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:44:06 2022] GET /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8 => generated 1724 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 21:44:07.166509 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [req-593779db-f699-49f7-9596-7e6eb2a63f5f req-31a74498-798e-46b1-8234-60d8c2642a94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "446bb786-0ec7-4542-9509-36282d7126c8", "name": "network-vif-deleted", "tag": "a93c27fd-fadb-4f8a-be75-eddb5e3c3921"}]} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:44:07.175448 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-593779db-f699-49f7-9596-7e6eb2a63f5f req-31a74498-798e-46b1-8234-60d8c2642a94 service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:44:07.176805 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-593779db-f699-49f7-9596-7e6eb2a63f5f req-31a74498-798e-46b1-8234-60d8c2642a94 service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:44:07.189064 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.compute.server_external_events [req-593779db-f699-49f7-9596-7e6eb2a63f5f req-31a74498-798e-46b1-8234-60d8c2642a94 service nova] Creating event network-vif-deleted:a93c27fd-fadb-4f8a-be75-eddb5e3c3921 for instance 446bb786-0ec7-4542-9509-36282d7126c8 on hv-cinder-83563 May 19 21:44:07.194157 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [req-593779db-f699-49f7-9596-7e6eb2a63f5f req-31a74498-798e-46b1-8234-60d8c2642a94 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.279021 May 19 21:44:07.195173 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 475/937] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 21:44:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 21:44:07.682688 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-38fb24a0-166f-4b4c-b8fd-1662a552e0ae tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:44:07.683517 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-38fb24a0-166f-4b4c-b8fd-1662a552e0ae tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: 446bb786-0ec7-4542-9509-36282d7126c8] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:44:07.695154 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-38fb24a0-166f-4b4c-b8fd-1662a552e0ae tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:44:07.695611 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-38fb24a0-166f-4b4c-b8fd-1662a552e0ae tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:44:07.696413 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-38fb24a0-166f-4b4c-b8fd-1662a552e0ae tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:44:07.696854 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-38fb24a0-166f-4b4c-b8fd-1662a552e0ae tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:44:07.715989 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.wsgi [None req-38fb24a0-166f-4b4c-b8fd-1662a552e0ae tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] HTTP exception thrown: Instance 446bb786-0ec7-4542-9509-36282d7126c8 could not be found. May 19 21:44:07.718034 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-38fb24a0-166f-4b4c-b8fd-1662a552e0ae tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Request method failure captured: May 19 21:44:07.718034 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: request: GET /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8 HTTP/1.1 May 19 21:44:07.718034 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Accept: application/json May 19 21:44:07.718034 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Accept-Encoding: identity May 19 21:44:07.718034 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Connection: close May 19 21:44:07.718034 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Content-Length: 0 May 19 21:44:07.718034 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Content-Type: application/json May 19 21:44:07.718034 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Host: 10.222.0.65 May 19 21:44:07.718034 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Openstack-System-Scope: None May 19 21:44:07.718034 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: User-Agent: python-urllib3/1.26.9 May 19 21:44:07.718034 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Auth-Token: gAAAAABihrdoc6hz2a2E2FuN7J_loAPbX8AXhy2RhsogI1W53kPZ59m7exARIi3hxYKQ7C6wyovLzjKkZcXQCKC0tQ1Gh_qG8pRtA_FTMargAAyCvpgFo2ObI_PTLJ4x15IiqBl110v9uavHO9t1uxTFspcE_biaBQqaMWYlj3RW2oqYxHj9nLw May 19 21:44:07.718034 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Domain-Id: None May 19 21:44:07.718034 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Domain-Name: None May 19 21:44:07.718034 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Identity-Status: Confirmed May 19 21:44:07.718034 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Is-Admin-Project: True May 19 21:44:07.718034 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Openstack-Nova-Api-Version: 2.20 May 19 21:44:07.718034 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Project-Domain-Id: default May 19 21:44:07.718034 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Project-Domain-Name: Default May 19 21:44:07.718034 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Project-Id: 92434c51e27a405aaa89a70a660f6d91 May 19 21:44:07.718034 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1939131256 May 19 21:44:07.718034 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Role: reader,member May 19 21:44:07.718034 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Roles: reader,member May 19 21:44:07.719945 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/92434c51e27a405aaa89a70a660f6d91"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/92434c51e27a405aaa89a70a660f6d91"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_92434c51e27a405aaa89a70a660f6d91"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/92434c51e27a405aaa89a70a660f6d91"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}] May 19 21:44:07.719945 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1939131256 May 19 21:44:07.719945 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Tenant-Id: 92434c51e27a405aaa89a70a660f6d91 May 19 21:44:07.719945 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1939131256 May 19 21:44:07.719945 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-User: tempest-AttachVolumeShelveTestJSON-1939131256-project May 19 21:44:07.719945 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-User-Domain-Id: default May 19 21:44:07.719945 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-User-Domain-Name: Default May 19 21:44:07.719945 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-User-Id: f47e7f746a014cb0a35390e7e0ce435d May 19 21:44:07.719945 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1939131256-project May 19 21:44:07.719945 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: method: > May 19 21:44:07.719945 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: exception: Instance 446bb786-0ec7-4542-9509-36282d7126c8 could not be found. May 19 21:44:07.719945 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: action_args: {'id': '446bb786-0ec7-4542-9509-36282d7126c8'} May 19 21:44:07.720951 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 21:44:07.720951 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:44:07.720951 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 21:44:07.720951 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 21:44:07.720951 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 21:44:07.720951 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 21:44:07.720951 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 21:44:07.720951 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 21:44:07.720951 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 21:44:07.720951 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 21:44:07.720951 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 446bb786-0ec7-4542-9509-36282d7126c8 could not be found. May 19 21:44:07.720951 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:44:07.720951 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 21:44:07.720951 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:44:07.720951 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:44:07.720951 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 21:44:07.720951 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 21:44:07.720951 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 21:44:07.720951 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 21:44:07.720951 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 21:44:07.722420 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 21:44:07.722420 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 21:44:07.722420 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 21:44:07.722420 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 21:44:07.722420 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 21:44:07.722420 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 21:44:07.722420 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 21:44:07.722420 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 446bb786-0ec7-4542-9509-36282d7126c8 could not be found. May 19 21:44:07.722420 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:44:07.722420 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 21:44:07.722420 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:44:07.722420 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:44:07.722420 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 21:44:07.722420 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 21:44:07.722420 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 21:44:07.722420 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 21:44:07.722420 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 446bb786-0ec7-4542-9509-36282d7126c8 could not be found. May 19 21:44:07.722420 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:44:07.723677 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-38fb24a0-166f-4b4c-b8fd-1662a552e0ae tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Returning 404 to user: Instance 446bb786-0ec7-4542-9509-36282d7126c8 could not be found. {{(pid=124349) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 21:44:07.723677 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-38fb24a0-166f-4b4c-b8fd-1662a552e0ae tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8" status: 404 len: 111 microversion: 2.20 time: 0.041919 May 19 21:44:07.723677 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 463/938] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:44:07 2022] GET /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 19 21:44:07.729842 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-9ec21a59-f33a-4c65-90ee-fb9fd416d897 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '.version_select at 0x7fe3636958b0>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:44:07.750556 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-9ec21a59-f33a-4c65-90ee-fb9fd416d897 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-609015647" status: 204 len: 0 microversion: 2.20 time: 0.024900 May 19 21:44:07.751149 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 476/939] 10.222.0.65 () {60 vars in 1258 bytes} [Thu May 19 21:44:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-609015647 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 19 21:44:09.708466 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-a1fb23c3-f719-4c20-b55f-5ba8defda140 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:44:09.708963 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-a1fb23c3-f719-4c20-b55f-5ba8defda140 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: 446bb786-0ec7-4542-9509-36282d7126c8] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:44:09.715884 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a1fb23c3-f719-4c20-b55f-5ba8defda140 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:44:09.716316 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a1fb23c3-f719-4c20-b55f-5ba8defda140 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:44:09.717079 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a1fb23c3-f719-4c20-b55f-5ba8defda140 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:44:09.717598 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a1fb23c3-f719-4c20-b55f-5ba8defda140 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:44:09.733456 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.wsgi [None req-a1fb23c3-f719-4c20-b55f-5ba8defda140 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] HTTP exception thrown: Instance 446bb786-0ec7-4542-9509-36282d7126c8 could not be found. May 19 21:44:09.735095 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-a1fb23c3-f719-4c20-b55f-5ba8defda140 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Request method failure captured: May 19 21:44:09.735095 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: request: DELETE /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8 HTTP/1.1 May 19 21:44:09.735095 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Accept: application/json May 19 21:44:09.735095 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Accept-Encoding: identity May 19 21:44:09.735095 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Connection: close May 19 21:44:09.735095 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Content-Length: 0 May 19 21:44:09.735095 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Content-Type: application/json May 19 21:44:09.735095 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Host: 10.222.0.65 May 19 21:44:09.735095 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Openstack-System-Scope: None May 19 21:44:09.735095 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: User-Agent: python-urllib3/1.26.9 May 19 21:44:09.735095 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Auth-Token: gAAAAABihrdoc6hz2a2E2FuN7J_loAPbX8AXhy2RhsogI1W53kPZ59m7exARIi3hxYKQ7C6wyovLzjKkZcXQCKC0tQ1Gh_qG8pRtA_FTMargAAyCvpgFo2ObI_PTLJ4x15IiqBl110v9uavHO9t1uxTFspcE_biaBQqaMWYlj3RW2oqYxHj9nLw May 19 21:44:09.735095 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Domain-Id: None May 19 21:44:09.735095 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Domain-Name: None May 19 21:44:09.735095 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Identity-Status: Confirmed May 19 21:44:09.735095 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Is-Admin-Project: True May 19 21:44:09.735095 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Openstack-Nova-Api-Version: 2.20 May 19 21:44:09.735095 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Project-Domain-Id: default May 19 21:44:09.735095 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Project-Domain-Name: Default May 19 21:44:09.735095 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Project-Id: 92434c51e27a405aaa89a70a660f6d91 May 19 21:44:09.735095 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1939131256 May 19 21:44:09.735095 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Role: reader,member May 19 21:44:09.735095 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Roles: reader,member May 19 21:44:09.737646 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/92434c51e27a405aaa89a70a660f6d91"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/92434c51e27a405aaa89a70a660f6d91"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_92434c51e27a405aaa89a70a660f6d91"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/92434c51e27a405aaa89a70a660f6d91"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}] May 19 21:44:09.737646 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1939131256 May 19 21:44:09.737646 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Tenant-Id: 92434c51e27a405aaa89a70a660f6d91 May 19 21:44:09.737646 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1939131256 May 19 21:44:09.737646 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-User: tempest-AttachVolumeShelveTestJSON-1939131256-project May 19 21:44:09.737646 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-User-Domain-Id: default May 19 21:44:09.737646 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-User-Domain-Name: Default May 19 21:44:09.737646 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-User-Id: f47e7f746a014cb0a35390e7e0ce435d May 19 21:44:09.737646 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1939131256-project May 19 21:44:09.737646 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: method: > May 19 21:44:09.737646 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: exception: Instance 446bb786-0ec7-4542-9509-36282d7126c8 could not be found. May 19 21:44:09.737646 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: action_args: {'id': '446bb786-0ec7-4542-9509-36282d7126c8'} May 19 21:44:09.739395 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 21:44:09.739395 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:44:09.739395 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 21:44:09.739395 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 21:44:09.739395 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 21:44:09.739395 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 21:44:09.739395 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 21:44:09.739395 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 21:44:09.739395 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 21:44:09.739395 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 21:44:09.739395 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 446bb786-0ec7-4542-9509-36282d7126c8 could not be found. May 19 21:44:09.739395 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:44:09.739395 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 21:44:09.739395 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:44:09.739395 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:44:09.739395 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 21:44:09.739395 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 21:44:09.739395 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 21:44:09.739395 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 21:44:09.739395 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 21:44:09.741954 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 21:44:09.741954 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 19 21:44:09.741954 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 21:44:09.741954 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 19 21:44:09.741954 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 21:44:09.741954 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 21:44:09.741954 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 21:44:09.741954 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 21:44:09.741954 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 21:44:09.741954 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 446bb786-0ec7-4542-9509-36282d7126c8 could not be found. May 19 21:44:09.741954 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:44:09.741954 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 21:44:09.741954 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:44:09.741954 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:44:09.741954 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 21:44:09.741954 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 21:44:09.741954 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 21:44:09.741954 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 21:44:09.741954 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 446bb786-0ec7-4542-9509-36282d7126c8 could not be found. May 19 21:44:09.741954 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:44:09.744584 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-a1fb23c3-f719-4c20-b55f-5ba8defda140 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Returning 404 to user: Instance 446bb786-0ec7-4542-9509-36282d7126c8 could not be found. {{(pid=124349) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 21:44:09.744584 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-a1fb23c3-f719-4c20-b55f-5ba8defda140 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "DELETE /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8" status: 404 len: 111 microversion: 2.20 time: 0.032063 May 19 21:44:09.744584 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 464/940] 10.222.0.65 () {60 vars in 1279 bytes} [Thu May 19 21:44:09 2022] DELETE /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 19 21:44:09.746218 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-b2cf6cab-8be3-4f6c-bda5-35c42800bed6 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:44:09.747064 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-b2cf6cab-8be3-4f6c-bda5-35c42800bed6 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: 446bb786-0ec7-4542-9509-36282d7126c8] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:44:09.754824 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b2cf6cab-8be3-4f6c-bda5-35c42800bed6 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:44:09.755366 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b2cf6cab-8be3-4f6c-bda5-35c42800bed6 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:44:09.756071 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b2cf6cab-8be3-4f6c-bda5-35c42800bed6 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:44:09.756479 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b2cf6cab-8be3-4f6c-bda5-35c42800bed6 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:44:09.778454 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.wsgi [None req-b2cf6cab-8be3-4f6c-bda5-35c42800bed6 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] HTTP exception thrown: Instance 446bb786-0ec7-4542-9509-36282d7126c8 could not be found. May 19 21:44:09.782070 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-b2cf6cab-8be3-4f6c-bda5-35c42800bed6 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Request method failure captured: May 19 21:44:09.782070 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: request: GET /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8 HTTP/1.1 May 19 21:44:09.782070 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Accept: application/json May 19 21:44:09.782070 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Accept-Encoding: identity May 19 21:44:09.782070 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Connection: close May 19 21:44:09.782070 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Content-Length: 0 May 19 21:44:09.782070 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Content-Type: application/json May 19 21:44:09.782070 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Host: 10.222.0.65 May 19 21:44:09.782070 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Openstack-System-Scope: None May 19 21:44:09.782070 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: User-Agent: python-urllib3/1.26.9 May 19 21:44:09.782070 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Auth-Token: gAAAAABihrdoc6hz2a2E2FuN7J_loAPbX8AXhy2RhsogI1W53kPZ59m7exARIi3hxYKQ7C6wyovLzjKkZcXQCKC0tQ1Gh_qG8pRtA_FTMargAAyCvpgFo2ObI_PTLJ4x15IiqBl110v9uavHO9t1uxTFspcE_biaBQqaMWYlj3RW2oqYxHj9nLw May 19 21:44:09.782070 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Domain-Id: None May 19 21:44:09.782070 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Domain-Name: None May 19 21:44:09.782070 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Identity-Status: Confirmed May 19 21:44:09.782070 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Is-Admin-Project: True May 19 21:44:09.782070 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Openstack-Nova-Api-Version: 2.20 May 19 21:44:09.782070 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Project-Domain-Id: default May 19 21:44:09.782070 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Project-Domain-Name: Default May 19 21:44:09.782070 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Project-Id: 92434c51e27a405aaa89a70a660f6d91 May 19 21:44:09.782070 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1939131256 May 19 21:44:09.782070 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Role: reader,member May 19 21:44:09.782070 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Roles: reader,member May 19 21:44:09.784267 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/92434c51e27a405aaa89a70a660f6d91"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/92434c51e27a405aaa89a70a660f6d91"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_92434c51e27a405aaa89a70a660f6d91"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/92434c51e27a405aaa89a70a660f6d91"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}] May 19 21:44:09.784267 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1939131256 May 19 21:44:09.784267 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Tenant-Id: 92434c51e27a405aaa89a70a660f6d91 May 19 21:44:09.784267 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1939131256 May 19 21:44:09.784267 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-User: tempest-AttachVolumeShelveTestJSON-1939131256-project May 19 21:44:09.784267 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-User-Domain-Id: default May 19 21:44:09.784267 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-User-Domain-Name: Default May 19 21:44:09.784267 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-User-Id: f47e7f746a014cb0a35390e7e0ce435d May 19 21:44:09.784267 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1939131256-project May 19 21:44:09.784267 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: method: > May 19 21:44:09.784267 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: exception: Instance 446bb786-0ec7-4542-9509-36282d7126c8 could not be found. May 19 21:44:09.784267 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: action_args: {'id': '446bb786-0ec7-4542-9509-36282d7126c8'} May 19 21:44:09.785185 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 21:44:09.785185 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:44:09.785185 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 21:44:09.785185 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 21:44:09.785185 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 21:44:09.785185 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 21:44:09.785185 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 21:44:09.785185 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 21:44:09.785185 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 21:44:09.785185 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 21:44:09.785185 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 446bb786-0ec7-4542-9509-36282d7126c8 could not be found. May 19 21:44:09.785185 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi May 19 21:44:09.785185 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 21:44:09.785185 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi May 19 21:44:09.785185 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:44:09.785185 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 21:44:09.785185 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 21:44:09.785185 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 21:44:09.785185 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 21:44:09.785185 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 21:44:09.786774 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 21:44:09.786774 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 21:44:09.786774 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 21:44:09.786774 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 21:44:09.786774 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 21:44:09.786774 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 21:44:09.786774 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 21:44:09.786774 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 446bb786-0ec7-4542-9509-36282d7126c8 could not be found. May 19 21:44:09.786774 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi May 19 21:44:09.786774 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 21:44:09.786774 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi May 19 21:44:09.786774 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:44:09.786774 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 21:44:09.786774 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 21:44:09.786774 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 21:44:09.786774 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 21:44:09.786774 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 446bb786-0ec7-4542-9509-36282d7126c8 could not be found. May 19 21:44:09.786774 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi May 19 21:44:09.788049 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-b2cf6cab-8be3-4f6c-bda5-35c42800bed6 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Returning 404 to user: Instance 446bb786-0ec7-4542-9509-36282d7126c8 could not be found. {{(pid=124350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 21:44:09.788049 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-b2cf6cab-8be3-4f6c-bda5-35c42800bed6 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8" status: 404 len: 111 microversion: 2.20 time: 0.042659 May 19 21:44:09.788049 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 477/941] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:44:09 2022] GET /compute/v2.1/servers/446bb786-0ec7-4542-9509-36282d7126c8 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) May 19 21:44:10.953990 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-dda96045-b32b-44f3-bbb2-58d47336aa60 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:44:10.954553 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-dda96045-b32b-44f3-bbb2-58d47336aa60 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: e0250d7d-3766-4555-a9af-2429afad53bf] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:44:10.961184 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-dda96045-b32b-44f3-bbb2-58d47336aa60 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:44:10.961582 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-dda96045-b32b-44f3-bbb2-58d47336aa60 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:44:10.962446 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-dda96045-b32b-44f3-bbb2-58d47336aa60 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:44:10.962823 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-dda96045-b32b-44f3-bbb2-58d47336aa60 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:44:10.977790 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.wsgi [None req-dda96045-b32b-44f3-bbb2-58d47336aa60 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] HTTP exception thrown: Instance e0250d7d-3766-4555-a9af-2429afad53bf could not be found. May 19 21:44:10.979413 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-dda96045-b32b-44f3-bbb2-58d47336aa60 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Request method failure captured: May 19 21:44:10.979413 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: request: DELETE /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf HTTP/1.1 May 19 21:44:10.979413 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Accept: application/json May 19 21:44:10.979413 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Accept-Encoding: identity May 19 21:44:10.979413 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Connection: close May 19 21:44:10.979413 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Content-Length: 0 May 19 21:44:10.979413 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Content-Type: application/json May 19 21:44:10.979413 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Host: 10.222.0.65 May 19 21:44:10.979413 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Openstack-System-Scope: None May 19 21:44:10.979413 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: User-Agent: python-urllib3/1.26.9 May 19 21:44:10.979413 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Auth-Token: gAAAAABihrdoc6hz2a2E2FuN7J_loAPbX8AXhy2RhsogI1W53kPZ59m7exARIi3hxYKQ7C6wyovLzjKkZcXQCKC0tQ1Gh_qG8pRtA_FTMargAAyCvpgFo2ObI_PTLJ4x15IiqBl110v9uavHO9t1uxTFspcE_biaBQqaMWYlj3RW2oqYxHj9nLw May 19 21:44:10.979413 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Domain-Id: None May 19 21:44:10.979413 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Domain-Name: None May 19 21:44:10.979413 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Identity-Status: Confirmed May 19 21:44:10.979413 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Is-Admin-Project: True May 19 21:44:10.979413 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Openstack-Nova-Api-Version: 2.20 May 19 21:44:10.979413 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Project-Domain-Id: default May 19 21:44:10.979413 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Project-Domain-Name: Default May 19 21:44:10.979413 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Project-Id: 92434c51e27a405aaa89a70a660f6d91 May 19 21:44:10.979413 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1939131256 May 19 21:44:10.979413 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Role: reader,member May 19 21:44:10.979413 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Roles: reader,member May 19 21:44:10.981055 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/92434c51e27a405aaa89a70a660f6d91"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/92434c51e27a405aaa89a70a660f6d91"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_92434c51e27a405aaa89a70a660f6d91"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/92434c51e27a405aaa89a70a660f6d91"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}] May 19 21:44:10.981055 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1939131256 May 19 21:44:10.981055 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Tenant-Id: 92434c51e27a405aaa89a70a660f6d91 May 19 21:44:10.981055 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1939131256 May 19 21:44:10.981055 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-User: tempest-AttachVolumeShelveTestJSON-1939131256-project May 19 21:44:10.981055 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-User-Domain-Id: default May 19 21:44:10.981055 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-User-Domain-Name: Default May 19 21:44:10.981055 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-User-Id: f47e7f746a014cb0a35390e7e0ce435d May 19 21:44:10.981055 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1939131256-project May 19 21:44:10.981055 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: method: > May 19 21:44:10.981055 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: exception: Instance e0250d7d-3766-4555-a9af-2429afad53bf could not be found. May 19 21:44:10.981055 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: action_args: {'id': 'e0250d7d-3766-4555-a9af-2429afad53bf'} May 19 21:44:10.981963 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 21:44:10.981963 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:44:10.981963 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 21:44:10.981963 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 21:44:10.981963 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 21:44:10.981963 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 21:44:10.981963 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 21:44:10.981963 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 21:44:10.981963 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 21:44:10.981963 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 21:44:10.981963 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0250d7d-3766-4555-a9af-2429afad53bf could not be found. May 19 21:44:10.981963 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:44:10.981963 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 21:44:10.981963 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:44:10.981963 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:44:10.981963 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 21:44:10.981963 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 21:44:10.981963 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 21:44:10.981963 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 21:44:10.981963 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 21:44:10.983503 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 21:44:10.983503 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 19 21:44:10.983503 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 21:44:10.983503 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 19 21:44:10.983503 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 21:44:10.983503 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 21:44:10.983503 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 21:44:10.983503 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 21:44:10.983503 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 21:44:10.983503 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0250d7d-3766-4555-a9af-2429afad53bf could not be found. May 19 21:44:10.983503 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:44:10.983503 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 21:44:10.983503 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:44:10.983503 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:44:10.983503 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 21:44:10.983503 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 21:44:10.983503 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 21:44:10.983503 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 21:44:10.983503 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0250d7d-3766-4555-a9af-2429afad53bf could not be found. May 19 21:44:10.983503 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:44:10.984962 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-dda96045-b32b-44f3-bbb2-58d47336aa60 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Returning 404 to user: Instance e0250d7d-3766-4555-a9af-2429afad53bf could not be found. {{(pid=124349) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 21:44:10.984962 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-dda96045-b32b-44f3-bbb2-58d47336aa60 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "DELETE /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf" status: 404 len: 111 microversion: 2.20 time: 0.031023 May 19 21:44:10.984962 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 465/942] 10.222.0.65 () {60 vars in 1279 bytes} [Thu May 19 21:44:10 2022] DELETE /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 19 21:44:10.994015 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-180e29b0-e2c7-46d8-a9bb-5e9ee15c7236 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:44:10.994674 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-180e29b0-e2c7-46d8-a9bb-5e9ee15c7236 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] [instance: e0250d7d-3766-4555-a9af-2429afad53bf] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:44:11.001521 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-180e29b0-e2c7-46d8-a9bb-5e9ee15c7236 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:44:11.001968 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-180e29b0-e2c7-46d8-a9bb-5e9ee15c7236 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:44:11.002803 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-180e29b0-e2c7-46d8-a9bb-5e9ee15c7236 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:44:11.003240 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-180e29b0-e2c7-46d8-a9bb-5e9ee15c7236 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:44:11.018132 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.wsgi [None req-180e29b0-e2c7-46d8-a9bb-5e9ee15c7236 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] HTTP exception thrown: Instance e0250d7d-3766-4555-a9af-2429afad53bf could not be found. May 19 21:44:11.020023 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-180e29b0-e2c7-46d8-a9bb-5e9ee15c7236 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Request method failure captured: May 19 21:44:11.020023 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: request: GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf HTTP/1.1 May 19 21:44:11.020023 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Accept: application/json May 19 21:44:11.020023 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Accept-Encoding: identity May 19 21:44:11.020023 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Connection: close May 19 21:44:11.020023 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Content-Length: 0 May 19 21:44:11.020023 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Content-Type: application/json May 19 21:44:11.020023 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Host: 10.222.0.65 May 19 21:44:11.020023 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Openstack-System-Scope: None May 19 21:44:11.020023 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: User-Agent: python-urllib3/1.26.9 May 19 21:44:11.020023 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Auth-Token: gAAAAABihrdoc6hz2a2E2FuN7J_loAPbX8AXhy2RhsogI1W53kPZ59m7exARIi3hxYKQ7C6wyovLzjKkZcXQCKC0tQ1Gh_qG8pRtA_FTMargAAyCvpgFo2ObI_PTLJ4x15IiqBl110v9uavHO9t1uxTFspcE_biaBQqaMWYlj3RW2oqYxHj9nLw May 19 21:44:11.020023 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Domain-Id: None May 19 21:44:11.020023 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Domain-Name: None May 19 21:44:11.020023 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Identity-Status: Confirmed May 19 21:44:11.020023 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Is-Admin-Project: True May 19 21:44:11.020023 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Openstack-Nova-Api-Version: 2.20 May 19 21:44:11.020023 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Project-Domain-Id: default May 19 21:44:11.020023 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Project-Domain-Name: Default May 19 21:44:11.020023 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Project-Id: 92434c51e27a405aaa89a70a660f6d91 May 19 21:44:11.020023 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1939131256 May 19 21:44:11.020023 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Role: reader,member May 19 21:44:11.020023 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Roles: reader,member May 19 21:44:11.021907 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/92434c51e27a405aaa89a70a660f6d91"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/92434c51e27a405aaa89a70a660f6d91"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_92434c51e27a405aaa89a70a660f6d91"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/92434c51e27a405aaa89a70a660f6d91"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}] May 19 21:44:11.021907 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1939131256 May 19 21:44:11.021907 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Tenant-Id: 92434c51e27a405aaa89a70a660f6d91 May 19 21:44:11.021907 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1939131256 May 19 21:44:11.021907 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-User: tempest-AttachVolumeShelveTestJSON-1939131256-project May 19 21:44:11.021907 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-User-Domain-Id: default May 19 21:44:11.021907 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-User-Domain-Name: Default May 19 21:44:11.021907 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-User-Id: f47e7f746a014cb0a35390e7e0ce435d May 19 21:44:11.021907 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1939131256-project May 19 21:44:11.021907 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: method: > May 19 21:44:11.021907 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: exception: Instance e0250d7d-3766-4555-a9af-2429afad53bf could not be found. May 19 21:44:11.021907 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: action_args: {'id': 'e0250d7d-3766-4555-a9af-2429afad53bf'} May 19 21:44:11.022835 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 21:44:11.022835 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:44:11.022835 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 21:44:11.022835 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 21:44:11.022835 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 21:44:11.022835 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 21:44:11.022835 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 21:44:11.022835 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 21:44:11.022835 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 21:44:11.022835 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 21:44:11.022835 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0250d7d-3766-4555-a9af-2429afad53bf could not be found. May 19 21:44:11.022835 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi May 19 21:44:11.022835 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 21:44:11.022835 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi May 19 21:44:11.022835 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:44:11.022835 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 21:44:11.022835 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 21:44:11.022835 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 21:44:11.022835 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 21:44:11.022835 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 21:44:11.024334 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 21:44:11.024334 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 21:44:11.024334 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 21:44:11.024334 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 21:44:11.024334 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 21:44:11.024334 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 21:44:11.024334 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 21:44:11.024334 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0250d7d-3766-4555-a9af-2429afad53bf could not be found. May 19 21:44:11.024334 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi May 19 21:44:11.024334 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 21:44:11.024334 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi May 19 21:44:11.024334 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:44:11.024334 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 21:44:11.024334 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 21:44:11.024334 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 21:44:11.024334 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 21:44:11.024334 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0250d7d-3766-4555-a9af-2429afad53bf could not be found. May 19 21:44:11.024334 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi May 19 21:44:11.025764 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-180e29b0-e2c7-46d8-a9bb-5e9ee15c7236 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] Returning 404 to user: Instance e0250d7d-3766-4555-a9af-2429afad53bf could not be found. {{(pid=124350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 21:44:11.025764 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-180e29b0-e2c7-46d8-a9bb-5e9ee15c7236 tempest-AttachVolumeShelveTestJSON-1939131256 tempest-AttachVolumeShelveTestJSON-1939131256-project] 10.222.0.65 "GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf" status: 404 len: 111 microversion: 2.20 time: 0.031296 May 19 21:44:11.025764 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 478/943] 10.222.0.65 () {60 vars in 1276 bytes} [Thu May 19 21:44:10 2022] GET /compute/v2.1/servers/e0250d7d-3766-4555-a9af-2429afad53bf => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 19 21:44:20.901038 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-7bba8838-5c45-4829-a4af-2034730f3589 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Action: 'create', calling method: .version_select at 0x7fe36352dca0>, body: {"keypair": {"name": "tempest-keypair-1862480501", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCWVNP9edHiOQSyDa5CWiBQBosS/8qGj7mcNKFSUScLuAscbns19Y251WwLm6jjb+LjW/lsjqPjQPT7SPVNf8/mihKJP8aJ0/N2UXoEtZEOlHe7wynfLuxD4r1lBw2FVWA=="}} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:44:20.917367 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.quota [None req-7bba8838-5c45-4829-a4af-2034730f3589 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Getting quotas for project 9a4ad8679d5446b591d4083529f992cc. Resources: {'key_pairs'} {{(pid=124349) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 21:44:20.921889 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.quota [None req-7bba8838-5c45-4829-a4af-2034730f3589 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Getting quotas for user b9bd7a1a0e804d23aaa68153549672c9 and project 9a4ad8679d5446b591d4083529f992cc. Resources: {'key_pairs'} {{(pid=124349) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 21:44:20.950535 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-7bba8838-5c45-4829-a4af-2034730f3589 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.182424 May 19 21:44:20.951170 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 466/944] 10.222.0.65 () {60 vars in 1158 bytes} [Thu May 19 21:44:20 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 21:44:22.404181 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-dc9cec33-05e2-444e-94d9-4ed7352203b2 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-103889017", "imageRef": "a874457a-f8a8-46f6-bdcc-1fa632a0d3c0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c2dc31bc-9d9f-4b3a-a6c3-4de0dc53e03d"}], "security_groups": [{"name": "tempest-securitygroup--1961987384"}], "key_name": "tempest-keypair-1862480501", "user_data": "}} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:44:22.411997 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:44:22.412971 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:44:22.523770 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.network.neutron [None req-dc9cec33-05e2-444e-94d9-4ed7352203b2 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] validate_networks() for [('c2dc31bc-9d9f-4b3a-a6c3-4de0dc53e03d', None, None, None, None, None)] {{(pid=124350) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 19 21:44:23.022777 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.virt.hardware [None req-dc9cec33-05e2-444e-94d9-4ed7352203b2 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Flavor limits 0:0:0 {{(pid=124350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 21:44:23.023470 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.virt.hardware [None req-dc9cec33-05e2-444e-94d9-4ed7352203b2 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Image limits 0:0:0 {{(pid=124350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 21:44:23.023924 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.virt.hardware [None req-dc9cec33-05e2-444e-94d9-4ed7352203b2 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Flavor pref 0:0:0 {{(pid=124350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 21:44:23.024371 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.virt.hardware [None req-dc9cec33-05e2-444e-94d9-4ed7352203b2 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Image pref 0:0:0 {{(pid=124350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 21:44:23.024924 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.virt.hardware [None req-dc9cec33-05e2-444e-94d9-4ed7352203b2 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 21:44:23.035653 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-dc9cec33-05e2-444e-94d9-4ed7352203b2 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:44:23.036040 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-dc9cec33-05e2-444e-94d9-4ed7352203b2 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:44:23.037630 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-dc9cec33-05e2-444e-94d9-4ed7352203b2 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:44:23.038747 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-dc9cec33-05e2-444e-94d9-4ed7352203b2 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:44:23.059833 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.quota [None req-dc9cec33-05e2-444e-94d9-4ed7352203b2 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Getting quotas for project 9a4ad8679d5446b591d4083529f992cc. Resources: {'ram', 'cores', 'instances'} {{(pid=124350) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 21:44:23.065441 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.quota [None req-dc9cec33-05e2-444e-94d9-4ed7352203b2 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Getting quotas for user b9bd7a1a0e804d23aaa68153549672c9 and project 9a4ad8679d5446b591d4083529f992cc. Resources: {'ram', 'cores', 'instances'} {{(pid=124350) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 21:44:23.079896 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-dc9cec33-05e2-444e-94d9-4ed7352203b2 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Going to run 1 instances... {{(pid=124350) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 21:44:23.082768 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-dc9cec33-05e2-444e-94d9-4ed7352203b2 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] [instance: 2d071024-fffe-422f-9730-0f429f40221b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a874457a-f8a8-46f6-bdcc-1fa632a0d3c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124350) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 21:44:23.138619 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-dc9cec33-05e2-444e-94d9-4ed7352203b2 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.738952 May 19 21:44:23.140102 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 479/945] 10.222.0.65 () {60 vars in 1146 bytes} [Thu May 19 21:44:22 2022] POST /compute/v2.1/servers => generated 402 bytes in 741 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 21:44:23.151898 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-16b156d7-bdc8-4a8a-b1a0-27b0eb15ff6c tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:44:23.152633 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-16b156d7-bdc8-4a8a-b1a0-27b0eb15ff6c tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] [instance: 2d071024-fffe-422f-9730-0f429f40221b] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:44:23.154782 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_cell1:SELECT=24 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:44:23.219607 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-16b156d7-bdc8-4a8a-b1a0-27b0eb15ff6c tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9bd7a1a0e804d23aaa68153549672c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4ad8679d5446b591d4083529f992cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:44:23.228195 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-16b156d7-bdc8-4a8a-b1a0-27b0eb15ff6c tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] 10.222.0.65 "GET /compute/v2.1/servers/2d071024-fffe-422f-9730-0f429f40221b" status: 200 len: 1241 microversion: 2.1 time: 0.080407 May 19 21:44:23.228790 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 467/946] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:44:23 2022] GET /compute/v2.1/servers/2d071024-fffe-422f-9730-0f429f40221b => generated 1241 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:44:24.247569 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-e15a36e3-e260-4f61-b84f-ae341f764eb3 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:44:24.248400 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-e15a36e3-e260-4f61-b84f-ae341f764eb3 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] [instance: 2d071024-fffe-422f-9730-0f429f40221b] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:44:24.257732 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e15a36e3-e260-4f61-b84f-ae341f764eb3 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:44:24.258174 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e15a36e3-e260-4f61-b84f-ae341f764eb3 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:44:24.259128 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e15a36e3-e260-4f61-b84f-ae341f764eb3 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:44:24.259564 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e15a36e3-e260-4f61-b84f-ae341f764eb3 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:44:24.338111 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-e15a36e3-e260-4f61-b84f-ae341f764eb3 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9bd7a1a0e804d23aaa68153549672c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4ad8679d5446b591d4083529f992cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:44:24.346990 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-e15a36e3-e260-4f61-b84f-ae341f764eb3 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] 10.222.0.65 "GET /compute/v2.1/servers/2d071024-fffe-422f-9730-0f429f40221b" status: 200 len: 1293 microversion: 2.1 time: 0.103803 May 19 21:44:24.348029 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 480/947] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:44:24 2022] GET /compute/v2.1/servers/2d071024-fffe-422f-9730-0f429f40221b => generated 1293 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:44:25.365044 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-7263b8f8-a9b1-496b-8e55-8e4b81156f15 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:44:25.365755 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-7263b8f8-a9b1-496b-8e55-8e4b81156f15 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] [instance: 2d071024-fffe-422f-9730-0f429f40221b] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:44:25.373455 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-7263b8f8-a9b1-496b-8e55-8e4b81156f15 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:44:25.374427 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-7263b8f8-a9b1-496b-8e55-8e4b81156f15 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:44:25.375418 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-7263b8f8-a9b1-496b-8e55-8e4b81156f15 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:44:25.375929 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-7263b8f8-a9b1-496b-8e55-8e4b81156f15 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:44:25.548566 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-7263b8f8-a9b1-496b-8e55-8e4b81156f15 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9bd7a1a0e804d23aaa68153549672c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4ad8679d5446b591d4083529f992cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:44:25.566454 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-7263b8f8-a9b1-496b-8e55-8e4b81156f15 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] 10.222.0.65 "GET /compute/v2.1/servers/2d071024-fffe-422f-9730-0f429f40221b" status: 200 len: 1367 microversion: 2.1 time: 0.204978 May 19 21:44:25.578837 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 468/948] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:44:25 2022] GET /compute/v2.1/servers/2d071024-fffe-422f-9730-0f429f40221b => generated 1367 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:44:26.036953 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [req-ded8a9cb-ae7f-45ba-8886-693298419bfb req-5769d2d1-d5d7-44cf-b1c3-d6fb9bcd31fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d071024-fffe-422f-9730-0f429f40221b", "tag": "2eae5b2b-b305-4be0-b92d-251bb9cc76ee"}]} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:44:26.049637 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-ded8a9cb-ae7f-45ba-8886-693298419bfb req-5769d2d1-d5d7-44cf-b1c3-d6fb9bcd31fa service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:44:26.050100 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-ded8a9cb-ae7f-45ba-8886-693298419bfb req-5769d2d1-d5d7-44cf-b1c3-d6fb9bcd31fa service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:44:26.063048 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.compute.server_external_events [req-ded8a9cb-ae7f-45ba-8886-693298419bfb req-5769d2d1-d5d7-44cf-b1c3-d6fb9bcd31fa service nova] Creating event network-changed:2eae5b2b-b305-4be0-b92d-251bb9cc76ee for instance 2d071024-fffe-422f-9730-0f429f40221b on hv-cinder-83563 May 19 21:44:26.070076 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [req-ded8a9cb-ae7f-45ba-8886-693298419bfb req-5769d2d1-d5d7-44cf-b1c3-d6fb9bcd31fa service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035967 May 19 21:44:26.071181 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 481/949] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 21:44:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 21:44:26.591105 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-12f9e54a-c281-49e2-89ca-7176cfdcfa76 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:44:26.592299 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-12f9e54a-c281-49e2-89ca-7176cfdcfa76 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] [instance: 2d071024-fffe-422f-9730-0f429f40221b] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:44:26.600946 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-12f9e54a-c281-49e2-89ca-7176cfdcfa76 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:44:26.601409 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-12f9e54a-c281-49e2-89ca-7176cfdcfa76 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:44:26.602178 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-12f9e54a-c281-49e2-89ca-7176cfdcfa76 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:44:26.602649 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-12f9e54a-c281-49e2-89ca-7176cfdcfa76 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:44:26.744464 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-12f9e54a-c281-49e2-89ca-7176cfdcfa76 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9bd7a1a0e804d23aaa68153549672c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4ad8679d5446b591d4083529f992cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:44:26.753340 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-12f9e54a-c281-49e2-89ca-7176cfdcfa76 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] 10.222.0.65 "GET /compute/v2.1/servers/2d071024-fffe-422f-9730-0f429f40221b" status: 200 len: 1367 microversion: 2.1 time: 0.165909 May 19 21:44:26.754043 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 469/950] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:44:26 2022] GET /compute/v2.1/servers/2d071024-fffe-422f-9730-0f429f40221b => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:44:27.771739 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-fc0fa04e-32ac-41eb-88f3-529b34638a59 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:44:27.772534 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-fc0fa04e-32ac-41eb-88f3-529b34638a59 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] [instance: 2d071024-fffe-422f-9730-0f429f40221b] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:44:27.780123 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-fc0fa04e-32ac-41eb-88f3-529b34638a59 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:44:27.780567 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-fc0fa04e-32ac-41eb-88f3-529b34638a59 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:44:27.781335 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-fc0fa04e-32ac-41eb-88f3-529b34638a59 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:44:27.781763 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-fc0fa04e-32ac-41eb-88f3-529b34638a59 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:44:27.931953 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-fc0fa04e-32ac-41eb-88f3-529b34638a59 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9bd7a1a0e804d23aaa68153549672c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4ad8679d5446b591d4083529f992cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:44:27.941548 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-fc0fa04e-32ac-41eb-88f3-529b34638a59 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] 10.222.0.65 "GET /compute/v2.1/servers/2d071024-fffe-422f-9730-0f429f40221b" status: 200 len: 1367 microversion: 2.1 time: 0.174532 May 19 21:44:27.942210 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 482/951] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:44:27 2022] GET /compute/v2.1/servers/2d071024-fffe-422f-9730-0f429f40221b => generated 1367 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:44:28.961986 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-4dacf1d4-cc66-45ac-855f-63d95e43a3b0 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:44:28.962604 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-4dacf1d4-cc66-45ac-855f-63d95e43a3b0 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] [instance: 2d071024-fffe-422f-9730-0f429f40221b] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:44:28.970584 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-4dacf1d4-cc66-45ac-855f-63d95e43a3b0 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:44:28.971079 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-4dacf1d4-cc66-45ac-855f-63d95e43a3b0 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:44:28.972215 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-4dacf1d4-cc66-45ac-855f-63d95e43a3b0 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:44:28.972654 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-4dacf1d4-cc66-45ac-855f-63d95e43a3b0 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:44:29.120434 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-4dacf1d4-cc66-45ac-855f-63d95e43a3b0 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9bd7a1a0e804d23aaa68153549672c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4ad8679d5446b591d4083529f992cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:44:29.130123 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-4dacf1d4-cc66-45ac-855f-63d95e43a3b0 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] 10.222.0.65 "GET /compute/v2.1/servers/2d071024-fffe-422f-9730-0f429f40221b" status: 200 len: 1367 microversion: 2.1 time: 0.171961 May 19 21:44:29.131552 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 470/952] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:44:28 2022] GET /compute/v2.1/servers/2d071024-fffe-422f-9730-0f429f40221b => generated 1367 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:44:30.148100 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-0642f4b9-69b2-48d8-b757-c58674d96be3 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:44:30.148776 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-0642f4b9-69b2-48d8-b757-c58674d96be3 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] [instance: 2d071024-fffe-422f-9730-0f429f40221b] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:44:30.155713 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0642f4b9-69b2-48d8-b757-c58674d96be3 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:44:30.156310 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0642f4b9-69b2-48d8-b757-c58674d96be3 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:44:30.162891 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0642f4b9-69b2-48d8-b757-c58674d96be3 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:44:30.162891 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0642f4b9-69b2-48d8-b757-c58674d96be3 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:44:30.298214 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-0642f4b9-69b2-48d8-b757-c58674d96be3 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9bd7a1a0e804d23aaa68153549672c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4ad8679d5446b591d4083529f992cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:44:30.306343 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-0642f4b9-69b2-48d8-b757-c58674d96be3 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] 10.222.0.65 "GET /compute/v2.1/servers/2d071024-fffe-422f-9730-0f429f40221b" status: 200 len: 1367 microversion: 2.1 time: 0.162858 May 19 21:44:30.306922 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 483/953] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:44:30 2022] GET /compute/v2.1/servers/2d071024-fffe-422f-9730-0f429f40221b => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:44:31.325273 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-0d3e44b3-91cf-4be4-bdda-0d44a807d01b tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:44:31.327286 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-0d3e44b3-91cf-4be4-bdda-0d44a807d01b tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] [instance: 2d071024-fffe-422f-9730-0f429f40221b] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:44:31.336392 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-0d3e44b3-91cf-4be4-bdda-0d44a807d01b tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:44:31.337387 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-0d3e44b3-91cf-4be4-bdda-0d44a807d01b tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:44:31.338266 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-0d3e44b3-91cf-4be4-bdda-0d44a807d01b tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:44:31.338945 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-0d3e44b3-91cf-4be4-bdda-0d44a807d01b tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:44:31.478082 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-0d3e44b3-91cf-4be4-bdda-0d44a807d01b tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9bd7a1a0e804d23aaa68153549672c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4ad8679d5446b591d4083529f992cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:44:31.486885 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-0d3e44b3-91cf-4be4-bdda-0d44a807d01b tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] 10.222.0.65 "GET /compute/v2.1/servers/2d071024-fffe-422f-9730-0f429f40221b" status: 200 len: 1367 microversion: 2.1 time: 0.166313 May 19 21:44:31.487510 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 471/954] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:44:31 2022] GET /compute/v2.1/servers/2d071024-fffe-422f-9730-0f429f40221b => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:44:32.505978 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-c0700cc9-be57-4f86-8195-6bef3c348c46 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:44:32.506681 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-c0700cc9-be57-4f86-8195-6bef3c348c46 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] [instance: 2d071024-fffe-422f-9730-0f429f40221b] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:44:32.514485 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c0700cc9-be57-4f86-8195-6bef3c348c46 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:44:32.515067 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c0700cc9-be57-4f86-8195-6bef3c348c46 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:44:32.515836 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c0700cc9-be57-4f86-8195-6bef3c348c46 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:44:32.516266 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c0700cc9-be57-4f86-8195-6bef3c348c46 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:44:32.656870 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-c0700cc9-be57-4f86-8195-6bef3c348c46 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9bd7a1a0e804d23aaa68153549672c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4ad8679d5446b591d4083529f992cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:44:32.664973 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-c0700cc9-be57-4f86-8195-6bef3c348c46 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] 10.222.0.65 "GET /compute/v2.1/servers/2d071024-fffe-422f-9730-0f429f40221b" status: 200 len: 1367 microversion: 2.1 time: 0.163822 May 19 21:44:32.665812 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 484/955] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:44:32 2022] GET /compute/v2.1/servers/2d071024-fffe-422f-9730-0f429f40221b => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:44:32.890740 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [req-972e68f2-1221-4ea4-9c9e-7fc0bc2276c4 req-4d139c0f-ee19-4bd0-a4ad-d97f66e0b1c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d071024-fffe-422f-9730-0f429f40221b", "name": "network-vif-plugged", "status": "completed", "tag": "2eae5b2b-b305-4be0-b92d-251bb9cc76ee"}]} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:44:32.898987 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-972e68f2-1221-4ea4-9c9e-7fc0bc2276c4 req-4d139c0f-ee19-4bd0-a4ad-d97f66e0b1c8 service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:44:32.899426 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-972e68f2-1221-4ea4-9c9e-7fc0bc2276c4 req-4d139c0f-ee19-4bd0-a4ad-d97f66e0b1c8 service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:44:32.911082 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.compute.server_external_events [req-972e68f2-1221-4ea4-9c9e-7fc0bc2276c4 req-4d139c0f-ee19-4bd0-a4ad-d97f66e0b1c8 service nova] Creating event network-vif-plugged:2eae5b2b-b305-4be0-b92d-251bb9cc76ee for instance 2d071024-fffe-422f-9730-0f429f40221b on hv-cinder-83563 May 19 21:44:32.916279 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [req-972e68f2-1221-4ea4-9c9e-7fc0bc2276c4 req-4d139c0f-ee19-4bd0-a4ad-d97f66e0b1c8 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.176164 May 19 21:44:32.916878 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 472/956] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 21:44:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 21:44:33.686597 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-f691e3e8-883f-410a-a2ef-2fd901d19150 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:44:33.687293 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-f691e3e8-883f-410a-a2ef-2fd901d19150 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] [instance: 2d071024-fffe-422f-9730-0f429f40221b] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:44:33.690763 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell0:SELECT=2 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:44:33.691713 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell0:SELECT=6 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:44:33.700819 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f691e3e8-883f-410a-a2ef-2fd901d19150 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:44:33.701366 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f691e3e8-883f-410a-a2ef-2fd901d19150 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:44:33.702301 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f691e3e8-883f-410a-a2ef-2fd901d19150 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:44:33.702928 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f691e3e8-883f-410a-a2ef-2fd901d19150 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:44:33.879557 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-f691e3e8-883f-410a-a2ef-2fd901d19150 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9bd7a1a0e804d23aaa68153549672c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4ad8679d5446b591d4083529f992cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:44:33.888140 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-f691e3e8-883f-410a-a2ef-2fd901d19150 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] 10.222.0.65 "GET /compute/v2.1/servers/2d071024-fffe-422f-9730-0f429f40221b" status: 200 len: 1367 microversion: 2.1 time: 0.208133 May 19 21:44:33.889356 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 485/957] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:44:33 2022] GET /compute/v2.1/servers/2d071024-fffe-422f-9730-0f429f40221b => generated 1367 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:44:34.906249 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-b9caea5c-ec0f-43db-a66e-421b849b1afe tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:44:34.906953 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-b9caea5c-ec0f-43db-a66e-421b849b1afe tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] [instance: 2d071024-fffe-422f-9730-0f429f40221b] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:44:34.909213 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_cell0:SELECT=6 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:44:34.910598 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:44:34.916782 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-b9caea5c-ec0f-43db-a66e-421b849b1afe tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:44:34.917212 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-b9caea5c-ec0f-43db-a66e-421b849b1afe tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:44:34.917932 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-b9caea5c-ec0f-43db-a66e-421b849b1afe tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:44:34.918436 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-b9caea5c-ec0f-43db-a66e-421b849b1afe tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:44:35.073693 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-b9caea5c-ec0f-43db-a66e-421b849b1afe tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9bd7a1a0e804d23aaa68153549672c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4ad8679d5446b591d4083529f992cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:44:35.083049 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-b9caea5c-ec0f-43db-a66e-421b849b1afe tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] 10.222.0.65 "GET /compute/v2.1/servers/2d071024-fffe-422f-9730-0f429f40221b" status: 200 len: 1556 microversion: 2.1 time: 0.181124 May 19 21:44:35.084176 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 473/958] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:44:34 2022] GET /compute/v2.1/servers/2d071024-fffe-422f-9730-0f429f40221b => generated 1556 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:44:35.100886 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-87ed15f2-81a5-43bd-aaae-cf4bc0055b93 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:44:35.101514 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-87ed15f2-81a5-43bd-aaae-cf4bc0055b93 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] [instance: 2d071024-fffe-422f-9730-0f429f40221b] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:44:35.109007 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-87ed15f2-81a5-43bd-aaae-cf4bc0055b93 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:44:35.109455 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-87ed15f2-81a5-43bd-aaae-cf4bc0055b93 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:44:35.110229 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-87ed15f2-81a5-43bd-aaae-cf4bc0055b93 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:44:35.110727 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-87ed15f2-81a5-43bd-aaae-cf4bc0055b93 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:44:35.201438 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-87ed15f2-81a5-43bd-aaae-cf4bc0055b93 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] 10.222.0.65 "GET /compute/v2.1/servers/2d071024-fffe-422f-9730-0f429f40221b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.104321 May 19 21:44:35.202785 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 486/959] 10.222.0.65 () {58 vars in 1274 bytes} [Thu May 19 21:44:35 2022] GET /compute/v2.1/servers/2d071024-fffe-422f-9730-0f429f40221b/os-interface => generated 284 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 21:44:36.470271 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [req-66f4e914-ef13-44ea-bc00-445a90741769 req-98906373-a104-471d-9eb7-c63866d3f235 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d071024-fffe-422f-9730-0f429f40221b", "tag": "2eae5b2b-b305-4be0-b92d-251bb9cc76ee"}]} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:44:36.483967 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-66f4e914-ef13-44ea-bc00-445a90741769 req-98906373-a104-471d-9eb7-c63866d3f235 service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:44:36.484701 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-66f4e914-ef13-44ea-bc00-445a90741769 req-98906373-a104-471d-9eb7-c63866d3f235 service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:44:36.496567 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.compute.server_external_events [req-66f4e914-ef13-44ea-bc00-445a90741769 req-98906373-a104-471d-9eb7-c63866d3f235 service nova] Creating event network-changed:2eae5b2b-b305-4be0-b92d-251bb9cc76ee for instance 2d071024-fffe-422f-9730-0f429f40221b on hv-cinder-83563 May 19 21:44:36.502190 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [req-66f4e914-ef13-44ea-bc00-445a90741769 req-98906373-a104-471d-9eb7-c63866d3f235 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038842 May 19 21:44:36.502840 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 474/960] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 21:44:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 21:45:21.757465 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:45:21.758650 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell1:SELECT=38 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:45:21.760888 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_api:SELECT=3 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:45:21.761817 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_cell1:SELECT=34 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:45:21.762408 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-0a4c3a31-8293-4f5a-b156-f557f1c9a819 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:45:21.762900 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-0a4c3a31-8293-4f5a-b156-f557f1c9a819 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] [instance: 365bcd45-f5a7-4207-8767-ef081a3f46b7] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:45:21.766855 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [req-75a63ab6-c013-4efc-940d-d32641ad8084 req-e6bdb9a5-2070-471c-bff0-0fa0c138b439 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "365bcd45-f5a7-4207-8767-ef081a3f46b7", "tag": "76df0d38-9d1e-444b-9684-faaab6f94a92"}]} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:45:21.775702 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0a4c3a31-8293-4f5a-b156-f557f1c9a819 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:45:21.775927 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0a4c3a31-8293-4f5a-b156-f557f1c9a819 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:45:21.776781 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0a4c3a31-8293-4f5a-b156-f557f1c9a819 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:45:21.776899 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-75a63ab6-c013-4efc-940d-d32641ad8084 req-e6bdb9a5-2070-471c-bff0-0fa0c138b439 service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:45:21.777211 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0a4c3a31-8293-4f5a-b156-f557f1c9a819 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:45:21.777379 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-75a63ab6-c013-4efc-940d-d32641ad8084 req-e6bdb9a5-2070-471c-bff0-0fa0c138b439 service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:45:21.791372 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.compute.server_external_events [req-75a63ab6-c013-4efc-940d-d32641ad8084 req-e6bdb9a5-2070-471c-bff0-0fa0c138b439 service nova] Creating event network-changed:76df0d38-9d1e-444b-9684-faaab6f94a92 for instance 365bcd45-f5a7-4207-8767-ef081a3f46b7 on hv-cinder-83563 May 19 21:45:21.796964 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [req-75a63ab6-c013-4efc-940d-d32641ad8084 req-e6bdb9a5-2070-471c-bff0-0fa0c138b439 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038440 May 19 21:45:21.798009 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 475/961] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 21:45:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 21:45:21.806327 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-0a4c3a31-8293-4f5a-b156-f557f1c9a819 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] [instance: 365bcd45-f5a7-4207-8767-ef081a3f46b7] Going to try to terminate instance {{(pid=124350) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 21:45:21.893118 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-0a4c3a31-8293-4f5a-b156-f557f1c9a819 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] 10.222.0.65 "DELETE /compute/v2.1/servers/365bcd45-f5a7-4207-8767-ef081a3f46b7" status: 204 len: 0 microversion: 2.1 time: 0.136945 May 19 21:45:21.893857 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 487/962] 10.222.0.65 () {58 vars in 1238 bytes} [Thu May 19 21:45:21 2022] DELETE /compute/v2.1/servers/365bcd45-f5a7-4207-8767-ef081a3f46b7 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 21:45:21.904119 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-103036e6-597b-4df9-9009-8c14b6fd8ca9 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:45:21.905611 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-103036e6-597b-4df9-9009-8c14b6fd8ca9 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] [instance: 365bcd45-f5a7-4207-8767-ef081a3f46b7] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:45:21.913390 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-103036e6-597b-4df9-9009-8c14b6fd8ca9 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:45:21.914126 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-103036e6-597b-4df9-9009-8c14b6fd8ca9 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:45:21.915099 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-103036e6-597b-4df9-9009-8c14b6fd8ca9 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:45:21.915818 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-103036e6-597b-4df9-9009-8c14b6fd8ca9 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:45:22.058582 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-103036e6-597b-4df9-9009-8c14b6fd8ca9 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a58f82117ab437cab5607c204c86547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4951b93f86e1485692a4aae7b9ece8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:45:22.066770 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-103036e6-597b-4df9-9009-8c14b6fd8ca9 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] 10.222.0.65 "GET /compute/v2.1/servers/365bcd45-f5a7-4207-8767-ef081a3f46b7" status: 200 len: 1578 microversion: 2.1 time: 0.167425 May 19 21:45:22.067381 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 476/963] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:45:21 2022] GET /compute/v2.1/servers/365bcd45-f5a7-4207-8767-ef081a3f46b7 => generated 1578 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 21:45:23.093088 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-03f8c199-d167-4eb1-9fd6-6fdc7960b381 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:45:23.094232 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-03f8c199-d167-4eb1-9fd6-6fdc7960b381 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] [instance: 365bcd45-f5a7-4207-8767-ef081a3f46b7] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:45:23.105105 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-03f8c199-d167-4eb1-9fd6-6fdc7960b381 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:45:23.105547 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-03f8c199-d167-4eb1-9fd6-6fdc7960b381 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:45:23.106363 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-03f8c199-d167-4eb1-9fd6-6fdc7960b381 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:45:23.106794 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-03f8c199-d167-4eb1-9fd6-6fdc7960b381 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:45:23.275942 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-03f8c199-d167-4eb1-9fd6-6fdc7960b381 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a58f82117ab437cab5607c204c86547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4951b93f86e1485692a4aae7b9ece8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:45:23.287243 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-03f8c199-d167-4eb1-9fd6-6fdc7960b381 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] 10.222.0.65 "GET /compute/v2.1/servers/365bcd45-f5a7-4207-8767-ef081a3f46b7" status: 200 len: 1578 microversion: 2.1 time: 0.199467 May 19 21:45:23.287861 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 488/964] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:45:23 2022] GET /compute/v2.1/servers/365bcd45-f5a7-4207-8767-ef081a3f46b7 => generated 1578 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:45:24.281822 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [req-a95362aa-0f7d-4157-9cbd-196ca5d04afe req-e6227d66-c844-43c5-b992-122873120516 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "365bcd45-f5a7-4207-8767-ef081a3f46b7", "name": "network-vif-deleted", "tag": "76df0d38-9d1e-444b-9684-faaab6f94a92"}]} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:45:24.295396 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-a95362aa-0f7d-4157-9cbd-196ca5d04afe req-e6227d66-c844-43c5-b992-122873120516 service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:45:24.295861 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-a95362aa-0f7d-4157-9cbd-196ca5d04afe req-e6227d66-c844-43c5-b992-122873120516 service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:45:24.310609 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-8bd6ff14-6a39-4e40-bc2b-5bad505a50cc tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:45:24.311354 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-8bd6ff14-6a39-4e40-bc2b-5bad505a50cc tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] [instance: 365bcd45-f5a7-4207-8767-ef081a3f46b7] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:45:24.318631 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8bd6ff14-6a39-4e40-bc2b-5bad505a50cc tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:45:24.318838 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.compute.server_external_events [req-a95362aa-0f7d-4157-9cbd-196ca5d04afe req-e6227d66-c844-43c5-b992-122873120516 service nova] Creating event network-vif-deleted:76df0d38-9d1e-444b-9684-faaab6f94a92 for instance 365bcd45-f5a7-4207-8767-ef081a3f46b7 on hv-cinder-83563 May 19 21:45:24.319082 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8bd6ff14-6a39-4e40-bc2b-5bad505a50cc tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:45:24.319862 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8bd6ff14-6a39-4e40-bc2b-5bad505a50cc tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:45:24.320297 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-8bd6ff14-6a39-4e40-bc2b-5bad505a50cc tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:45:24.324850 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [req-a95362aa-0f7d-4157-9cbd-196ca5d04afe req-e6227d66-c844-43c5-b992-122873120516 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048163 May 19 21:45:24.326403 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 477/965] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 21:45:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 21:45:24.389940 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-8bd6ff14-6a39-4e40-bc2b-5bad505a50cc tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a58f82117ab437cab5607c204c86547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4951b93f86e1485692a4aae7b9ece8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:45:24.402622 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-8bd6ff14-6a39-4e40-bc2b-5bad505a50cc tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] 10.222.0.65 "GET /compute/v2.1/servers/365bcd45-f5a7-4207-8767-ef081a3f46b7" status: 200 len: 1226 microversion: 2.1 time: 0.096219 May 19 21:45:24.403544 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 489/966] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:45:24 2022] GET /compute/v2.1/servers/365bcd45-f5a7-4207-8767-ef081a3f46b7 => generated 1226 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:45:25.425977 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-74fcd908-ebd2-4b2f-80b4-22ced64b4b5e tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:45:25.426870 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-74fcd908-ebd2-4b2f-80b4-22ced64b4b5e tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] [instance: 365bcd45-f5a7-4207-8767-ef081a3f46b7] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:45:25.434276 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-74fcd908-ebd2-4b2f-80b4-22ced64b4b5e tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:45:25.434720 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-74fcd908-ebd2-4b2f-80b4-22ced64b4b5e tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:45:25.435496 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-74fcd908-ebd2-4b2f-80b4-22ced64b4b5e tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:45:25.435925 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-74fcd908-ebd2-4b2f-80b4-22ced64b4b5e tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:45:25.451642 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.wsgi [None req-74fcd908-ebd2-4b2f-80b4-22ced64b4b5e tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] HTTP exception thrown: Instance 365bcd45-f5a7-4207-8767-ef081a3f46b7 could not be found. May 19 21:45:25.453312 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-74fcd908-ebd2-4b2f-80b4-22ced64b4b5e tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Request method failure captured: May 19 21:45:25.453312 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: request: GET /compute/v2.1/servers/365bcd45-f5a7-4207-8767-ef081a3f46b7 HTTP/1.1 May 19 21:45:25.453312 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Accept: application/json May 19 21:45:25.453312 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Accept-Encoding: identity May 19 21:45:25.453312 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Connection: close May 19 21:45:25.453312 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Content-Length: 0 May 19 21:45:25.453312 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Content-Type: application/json May 19 21:45:25.453312 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Host: 10.222.0.65 May 19 21:45:25.453312 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Openstack-System-Scope: None May 19 21:45:25.453312 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: User-Agent: python-urllib3/1.26.9 May 19 21:45:25.453312 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Auth-Token: gAAAAABihrfGK__DJuYwI5JFz7AYjoJ5gQpF1NeU2sp6GL9Qm9r1qL-i4GqBqmgs0jr4aqzBtoAgR05QaRiKLd4CAlxsJ2Ka7-M6bw7EJFeb6jfz-DF94qKLiELFhcDH5F0ovdWhowq_VcBc9NHl4Po_3pwvmY2AqKHahlmuAmlCLH3bMLBrU08 May 19 21:45:25.453312 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Domain-Id: None May 19 21:45:25.453312 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Domain-Name: None May 19 21:45:25.453312 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Identity-Status: Confirmed May 19 21:45:25.453312 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Is-Admin-Project: True May 19 21:45:25.453312 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Project-Domain-Id: default May 19 21:45:25.453312 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Project-Domain-Name: Default May 19 21:45:25.453312 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Project-Id: 4951b93f86e1485692a4aae7b9ece8f6 May 19 21:45:25.453312 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Project-Name: tempest-TestVolumeBootPattern-2027905667 May 19 21:45:25.453312 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Role: reader,member May 19 21:45:25.453312 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Roles: reader,member May 19 21:45:25.454972 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/4951b93f86e1485692a4aae7b9ece8f6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/4951b93f86e1485692a4aae7b9ece8f6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_4951b93f86e1485692a4aae7b9ece8f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/4951b93f86e1485692a4aae7b9ece8f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}] May 19 21:45:25.454972 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Tenant: tempest-TestVolumeBootPattern-2027905667 May 19 21:45:25.454972 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Tenant-Id: 4951b93f86e1485692a4aae7b9ece8f6 May 19 21:45:25.454972 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Tenant-Name: tempest-TestVolumeBootPattern-2027905667 May 19 21:45:25.454972 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-User: tempest-TestVolumeBootPattern-2027905667-project May 19 21:45:25.454972 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-User-Domain-Id: default May 19 21:45:25.454972 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-User-Domain-Name: Default May 19 21:45:25.454972 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-User-Id: 0a58f82117ab437cab5607c204c86547 May 19 21:45:25.454972 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-User-Name: tempest-TestVolumeBootPattern-2027905667-project May 19 21:45:25.454972 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: method: > May 19 21:45:25.454972 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: exception: Instance 365bcd45-f5a7-4207-8767-ef081a3f46b7 could not be found. May 19 21:45:25.454972 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: action_args: {'id': '365bcd45-f5a7-4207-8767-ef081a3f46b7'} May 19 21:45:25.455814 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 21:45:25.455814 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:45:25.455814 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 21:45:25.455814 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 21:45:25.455814 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 21:45:25.455814 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 21:45:25.455814 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 21:45:25.455814 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 21:45:25.455814 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 21:45:25.455814 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 21:45:25.455814 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 365bcd45-f5a7-4207-8767-ef081a3f46b7 could not be found. May 19 21:45:25.455814 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:45:25.455814 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 21:45:25.455814 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:45:25.455814 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:45:25.455814 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 21:45:25.455814 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 21:45:25.455814 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 21:45:25.455814 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 21:45:25.455814 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 21:45:25.457168 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 21:45:25.457168 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 21:45:25.457168 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 21:45:25.457168 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 21:45:25.457168 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 21:45:25.457168 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 21:45:25.457168 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 21:45:25.457168 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 365bcd45-f5a7-4207-8767-ef081a3f46b7 could not be found. May 19 21:45:25.457168 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:45:25.457168 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 21:45:25.457168 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:45:25.457168 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:45:25.457168 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 21:45:25.457168 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 21:45:25.457168 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 21:45:25.457168 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 21:45:25.457168 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 365bcd45-f5a7-4207-8767-ef081a3f46b7 could not be found. May 19 21:45:25.457168 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:45:25.458393 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-74fcd908-ebd2-4b2f-80b4-22ced64b4b5e tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Returning 404 to user: Instance 365bcd45-f5a7-4207-8767-ef081a3f46b7 could not be found. {{(pid=124349) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 21:45:25.458393 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-74fcd908-ebd2-4b2f-80b4-22ced64b4b5e tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] 10.222.0.65 "GET /compute/v2.1/servers/365bcd45-f5a7-4207-8767-ef081a3f46b7" status: 404 len: 111 microversion: 2.1 time: 0.033702 May 19 21:45:25.458393 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 478/967] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:45:25 2022] GET /compute/v2.1/servers/365bcd45-f5a7-4207-8767-ef081a3f46b7 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 21:45:28.978207 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [req-6910afa1-daab-4ff2-a406-faebabd73294 req-078056f9-05fa-4960-9895-9aabf710d73b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19887ef9-2867-4e11-ad73-ad8c2eb0871b", "tag": "1de7b941-4923-4121-aea7-13eb18ac70b9"}]} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:45:28.981224 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-b8bc309f-1901-473d-af60-966d634a561c tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:45:28.983223 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-b8bc309f-1901-473d-af60-966d634a561c tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] [instance: 19887ef9-2867-4e11-ad73-ad8c2eb0871b] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:45:28.992738 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b8bc309f-1901-473d-af60-966d634a561c tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:45:28.993592 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-6910afa1-daab-4ff2-a406-faebabd73294 req-078056f9-05fa-4960-9895-9aabf710d73b service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:45:28.993900 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b8bc309f-1901-473d-af60-966d634a561c tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:45:28.994033 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-6910afa1-daab-4ff2-a406-faebabd73294 req-078056f9-05fa-4960-9895-9aabf710d73b service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:45:28.995286 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b8bc309f-1901-473d-af60-966d634a561c tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:45:28.996141 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b8bc309f-1901-473d-af60-966d634a561c tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:45:29.007772 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.compute.server_external_events [req-6910afa1-daab-4ff2-a406-faebabd73294 req-078056f9-05fa-4960-9895-9aabf710d73b service nova] Creating event network-changed:1de7b941-4923-4121-aea7-13eb18ac70b9 for instance 19887ef9-2867-4e11-ad73-ad8c2eb0871b on hv-cinder-83563 May 19 21:45:29.014913 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [req-6910afa1-daab-4ff2-a406-faebabd73294 req-078056f9-05fa-4960-9895-9aabf710d73b service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043153 May 19 21:45:29.017029 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 479/968] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 21:45:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 21:45:29.033792 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-b8bc309f-1901-473d-af60-966d634a561c tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] [instance: 19887ef9-2867-4e11-ad73-ad8c2eb0871b] Going to try to terminate instance {{(pid=124350) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 21:45:29.144680 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-b8bc309f-1901-473d-af60-966d634a561c tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] 10.222.0.65 "DELETE /compute/v2.1/servers/19887ef9-2867-4e11-ad73-ad8c2eb0871b" status: 204 len: 0 microversion: 2.1 time: 0.176594 May 19 21:45:29.146342 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 490/969] 10.222.0.65 () {58 vars in 1238 bytes} [Thu May 19 21:45:28 2022] DELETE /compute/v2.1/servers/19887ef9-2867-4e11-ad73-ad8c2eb0871b => generated 0 bytes in 179 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 21:45:29.156123 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-c29c3463-38b1-4a27-8748-8ae5754a8f38 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:45:29.156999 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-c29c3463-38b1-4a27-8748-8ae5754a8f38 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] [instance: 19887ef9-2867-4e11-ad73-ad8c2eb0871b] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:45:29.164246 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c29c3463-38b1-4a27-8748-8ae5754a8f38 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:45:29.165611 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c29c3463-38b1-4a27-8748-8ae5754a8f38 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:45:29.166538 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c29c3463-38b1-4a27-8748-8ae5754a8f38 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:45:29.167906 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c29c3463-38b1-4a27-8748-8ae5754a8f38 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:45:29.328661 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-c29c3463-38b1-4a27-8748-8ae5754a8f38 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a58f82117ab437cab5607c204c86547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4951b93f86e1485692a4aae7b9ece8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:45:29.339883 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-c29c3463-38b1-4a27-8748-8ae5754a8f38 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] 10.222.0.65 "GET /compute/v2.1/servers/19887ef9-2867-4e11-ad73-ad8c2eb0871b" status: 200 len: 1578 microversion: 2.1 time: 0.187588 May 19 21:45:29.341189 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 480/970] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:45:29 2022] GET /compute/v2.1/servers/19887ef9-2867-4e11-ad73-ad8c2eb0871b => generated 1578 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:45:30.360647 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-81316a87-8726-4b20-9d6c-cb399c3e2f6d tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:45:30.361348 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-81316a87-8726-4b20-9d6c-cb399c3e2f6d tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] [instance: 19887ef9-2867-4e11-ad73-ad8c2eb0871b] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:45:30.368736 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-81316a87-8726-4b20-9d6c-cb399c3e2f6d tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:45:30.369295 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-81316a87-8726-4b20-9d6c-cb399c3e2f6d tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:45:30.370204 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-81316a87-8726-4b20-9d6c-cb399c3e2f6d tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:45:30.371319 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-81316a87-8726-4b20-9d6c-cb399c3e2f6d tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:45:30.440210 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-81316a87-8726-4b20-9d6c-cb399c3e2f6d tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a58f82117ab437cab5607c204c86547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4951b93f86e1485692a4aae7b9ece8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:45:30.449427 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-81316a87-8726-4b20-9d6c-cb399c3e2f6d tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] 10.222.0.65 "GET /compute/v2.1/servers/19887ef9-2867-4e11-ad73-ad8c2eb0871b" status: 200 len: 1391 microversion: 2.1 time: 0.093312 May 19 21:45:30.450273 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 491/971] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:45:30 2022] GET /compute/v2.1/servers/19887ef9-2867-4e11-ad73-ad8c2eb0871b => generated 1391 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:45:30.547879 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [req-83423e4c-d27a-45f1-81f7-2895f3a18887 req-61e205af-8c0e-4edb-85cf-d9e4668885d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19887ef9-2867-4e11-ad73-ad8c2eb0871b", "name": "network-vif-deleted", "tag": "1de7b941-4923-4121-aea7-13eb18ac70b9"}]} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:45:30.558868 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-83423e4c-d27a-45f1-81f7-2895f3a18887 req-61e205af-8c0e-4edb-85cf-d9e4668885d5 service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:45:30.559244 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-83423e4c-d27a-45f1-81f7-2895f3a18887 req-61e205af-8c0e-4edb-85cf-d9e4668885d5 service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:45:30.571715 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.compute.server_external_events [req-83423e4c-d27a-45f1-81f7-2895f3a18887 req-61e205af-8c0e-4edb-85cf-d9e4668885d5 service nova] Creating event network-vif-deleted:1de7b941-4923-4121-aea7-13eb18ac70b9 for instance 19887ef9-2867-4e11-ad73-ad8c2eb0871b on hv-cinder-83563 May 19 21:45:30.576673 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [req-83423e4c-d27a-45f1-81f7-2895f3a18887 req-61e205af-8c0e-4edb-85cf-d9e4668885d5 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.169083 May 19 21:45:30.577280 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 481/972] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 21:45:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 21:45:31.466446 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-acb8f04f-e410-4f67-a93d-8834a1e93b53 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:45:31.467099 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-acb8f04f-e410-4f67-a93d-8834a1e93b53 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] [instance: 19887ef9-2867-4e11-ad73-ad8c2eb0871b] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:45:31.474762 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-acb8f04f-e410-4f67-a93d-8834a1e93b53 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:45:31.475208 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-acb8f04f-e410-4f67-a93d-8834a1e93b53 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:45:31.476023 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-acb8f04f-e410-4f67-a93d-8834a1e93b53 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:45:31.476436 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-acb8f04f-e410-4f67-a93d-8834a1e93b53 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:45:31.492311 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.wsgi [None req-acb8f04f-e410-4f67-a93d-8834a1e93b53 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] HTTP exception thrown: Instance 19887ef9-2867-4e11-ad73-ad8c2eb0871b could not be found. May 19 21:45:31.493972 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-acb8f04f-e410-4f67-a93d-8834a1e93b53 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Request method failure captured: May 19 21:45:31.493972 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: request: GET /compute/v2.1/servers/19887ef9-2867-4e11-ad73-ad8c2eb0871b HTTP/1.1 May 19 21:45:31.493972 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Accept: application/json May 19 21:45:31.493972 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Accept-Encoding: identity May 19 21:45:31.493972 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Connection: close May 19 21:45:31.493972 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Content-Length: 0 May 19 21:45:31.493972 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Content-Type: application/json May 19 21:45:31.493972 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Host: 10.222.0.65 May 19 21:45:31.493972 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Openstack-System-Scope: None May 19 21:45:31.493972 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: User-Agent: python-urllib3/1.26.9 May 19 21:45:31.493972 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Auth-Token: gAAAAABihrfGK__DJuYwI5JFz7AYjoJ5gQpF1NeU2sp6GL9Qm9r1qL-i4GqBqmgs0jr4aqzBtoAgR05QaRiKLd4CAlxsJ2Ka7-M6bw7EJFeb6jfz-DF94qKLiELFhcDH5F0ovdWhowq_VcBc9NHl4Po_3pwvmY2AqKHahlmuAmlCLH3bMLBrU08 May 19 21:45:31.493972 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Domain-Id: None May 19 21:45:31.493972 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Domain-Name: None May 19 21:45:31.493972 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Identity-Status: Confirmed May 19 21:45:31.493972 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Is-Admin-Project: True May 19 21:45:31.493972 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Project-Domain-Id: default May 19 21:45:31.493972 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Project-Domain-Name: Default May 19 21:45:31.493972 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Project-Id: 4951b93f86e1485692a4aae7b9ece8f6 May 19 21:45:31.493972 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Project-Name: tempest-TestVolumeBootPattern-2027905667 May 19 21:45:31.493972 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Role: reader,member May 19 21:45:31.493972 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Roles: reader,member May 19 21:45:31.495614 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/4951b93f86e1485692a4aae7b9ece8f6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/4951b93f86e1485692a4aae7b9ece8f6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_4951b93f86e1485692a4aae7b9ece8f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/4951b93f86e1485692a4aae7b9ece8f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}] May 19 21:45:31.495614 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Tenant: tempest-TestVolumeBootPattern-2027905667 May 19 21:45:31.495614 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Tenant-Id: 4951b93f86e1485692a4aae7b9ece8f6 May 19 21:45:31.495614 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Tenant-Name: tempest-TestVolumeBootPattern-2027905667 May 19 21:45:31.495614 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-User: tempest-TestVolumeBootPattern-2027905667-project May 19 21:45:31.495614 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-User-Domain-Id: default May 19 21:45:31.495614 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-User-Domain-Name: Default May 19 21:45:31.495614 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-User-Id: 0a58f82117ab437cab5607c204c86547 May 19 21:45:31.495614 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-User-Name: tempest-TestVolumeBootPattern-2027905667-project May 19 21:45:31.495614 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: method: > May 19 21:45:31.495614 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: exception: Instance 19887ef9-2867-4e11-ad73-ad8c2eb0871b could not be found. May 19 21:45:31.495614 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: action_args: {'id': '19887ef9-2867-4e11-ad73-ad8c2eb0871b'} May 19 21:45:31.496708 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 21:45:31.496708 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:45:31.496708 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 21:45:31.496708 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 21:45:31.496708 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 21:45:31.496708 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 21:45:31.496708 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 21:45:31.496708 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 21:45:31.496708 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 21:45:31.496708 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 21:45:31.496708 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19887ef9-2867-4e11-ad73-ad8c2eb0871b could not be found. May 19 21:45:31.496708 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi May 19 21:45:31.496708 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 21:45:31.496708 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi May 19 21:45:31.496708 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:45:31.496708 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 21:45:31.496708 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 21:45:31.496708 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 21:45:31.496708 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 21:45:31.496708 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 21:45:31.498307 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 21:45:31.498307 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 21:45:31.498307 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 21:45:31.498307 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 21:45:31.498307 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 21:45:31.498307 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 21:45:31.498307 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 21:45:31.498307 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19887ef9-2867-4e11-ad73-ad8c2eb0871b could not be found. May 19 21:45:31.498307 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi May 19 21:45:31.498307 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 21:45:31.498307 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi May 19 21:45:31.498307 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:45:31.498307 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 21:45:31.498307 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 21:45:31.498307 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 21:45:31.498307 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 21:45:31.498307 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19887ef9-2867-4e11-ad73-ad8c2eb0871b could not be found. May 19 21:45:31.498307 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi May 19 21:45:31.499853 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-acb8f04f-e410-4f67-a93d-8834a1e93b53 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Returning 404 to user: Instance 19887ef9-2867-4e11-ad73-ad8c2eb0871b could not be found. {{(pid=124350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 21:45:31.499853 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-acb8f04f-e410-4f67-a93d-8834a1e93b53 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] 10.222.0.65 "GET /compute/v2.1/servers/19887ef9-2867-4e11-ad73-ad8c2eb0871b" status: 404 len: 111 microversion: 2.1 time: 0.033062 May 19 21:45:31.499853 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 492/973] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:45:31 2022] GET /compute/v2.1/servers/19887ef9-2867-4e11-ad73-ad8c2eb0871b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 21:45:31.976824 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-a960ebd4-f150-4b03-8773-00c2d8724b41 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:45:31.977346 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-a960ebd4-f150-4b03-8773-00c2d8724b41 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] [instance: 6442f189-c760-45c5-8313-4f1d3fe46461] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:45:31.985966 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a960ebd4-f150-4b03-8773-00c2d8724b41 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:45:31.986526 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a960ebd4-f150-4b03-8773-00c2d8724b41 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:45:31.987294 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a960ebd4-f150-4b03-8773-00c2d8724b41 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:45:31.987722 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a960ebd4-f150-4b03-8773-00c2d8724b41 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:45:32.002807 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.wsgi [None req-a960ebd4-f150-4b03-8773-00c2d8724b41 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] HTTP exception thrown: Instance 6442f189-c760-45c5-8313-4f1d3fe46461 could not be found. May 19 21:45:32.004479 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-a960ebd4-f150-4b03-8773-00c2d8724b41 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Request method failure captured: May 19 21:45:32.004479 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: request: DELETE /compute/v2.1/servers/6442f189-c760-45c5-8313-4f1d3fe46461 HTTP/1.1 May 19 21:45:32.004479 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Accept: application/json May 19 21:45:32.004479 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Accept-Encoding: identity May 19 21:45:32.004479 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Connection: close May 19 21:45:32.004479 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Content-Length: 0 May 19 21:45:32.004479 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Content-Type: application/json May 19 21:45:32.004479 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Host: 10.222.0.65 May 19 21:45:32.004479 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Openstack-System-Scope: None May 19 21:45:32.004479 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: User-Agent: python-urllib3/1.26.9 May 19 21:45:32.004479 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Auth-Token: gAAAAABihrfGK__DJuYwI5JFz7AYjoJ5gQpF1NeU2sp6GL9Qm9r1qL-i4GqBqmgs0jr4aqzBtoAgR05QaRiKLd4CAlxsJ2Ka7-M6bw7EJFeb6jfz-DF94qKLiELFhcDH5F0ovdWhowq_VcBc9NHl4Po_3pwvmY2AqKHahlmuAmlCLH3bMLBrU08 May 19 21:45:32.004479 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Domain-Id: None May 19 21:45:32.004479 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Domain-Name: None May 19 21:45:32.004479 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Identity-Status: Confirmed May 19 21:45:32.004479 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Is-Admin-Project: True May 19 21:45:32.004479 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Project-Domain-Id: default May 19 21:45:32.004479 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Project-Domain-Name: Default May 19 21:45:32.004479 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Project-Id: 4951b93f86e1485692a4aae7b9ece8f6 May 19 21:45:32.004479 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Project-Name: tempest-TestVolumeBootPattern-2027905667 May 19 21:45:32.004479 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Role: reader,member May 19 21:45:32.004479 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Roles: reader,member May 19 21:45:32.006077 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/4951b93f86e1485692a4aae7b9ece8f6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/4951b93f86e1485692a4aae7b9ece8f6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_4951b93f86e1485692a4aae7b9ece8f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/4951b93f86e1485692a4aae7b9ece8f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}] May 19 21:45:32.006077 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Tenant: tempest-TestVolumeBootPattern-2027905667 May 19 21:45:32.006077 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Tenant-Id: 4951b93f86e1485692a4aae7b9ece8f6 May 19 21:45:32.006077 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Tenant-Name: tempest-TestVolumeBootPattern-2027905667 May 19 21:45:32.006077 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-User: tempest-TestVolumeBootPattern-2027905667-project May 19 21:45:32.006077 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-User-Domain-Id: default May 19 21:45:32.006077 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-User-Domain-Name: Default May 19 21:45:32.006077 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-User-Id: 0a58f82117ab437cab5607c204c86547 May 19 21:45:32.006077 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-User-Name: tempest-TestVolumeBootPattern-2027905667-project May 19 21:45:32.006077 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: method: > May 19 21:45:32.006077 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: exception: Instance 6442f189-c760-45c5-8313-4f1d3fe46461 could not be found. May 19 21:45:32.006077 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: action_args: {'id': '6442f189-c760-45c5-8313-4f1d3fe46461'} May 19 21:45:32.006999 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 21:45:32.006999 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:45:32.006999 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 21:45:32.006999 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 21:45:32.006999 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 21:45:32.006999 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 21:45:32.006999 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 21:45:32.006999 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 21:45:32.006999 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 21:45:32.006999 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 21:45:32.006999 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6442f189-c760-45c5-8313-4f1d3fe46461 could not be found. May 19 21:45:32.006999 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:45:32.006999 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 21:45:32.006999 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:45:32.006999 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:45:32.006999 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 21:45:32.006999 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 21:45:32.006999 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 21:45:32.006999 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 21:45:32.006999 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 21:45:32.008590 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 21:45:32.008590 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 19 21:45:32.008590 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 21:45:32.008590 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 19 21:45:32.008590 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 21:45:32.008590 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 21:45:32.008590 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 21:45:32.008590 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 21:45:32.008590 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 21:45:32.008590 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6442f189-c760-45c5-8313-4f1d3fe46461 could not be found. May 19 21:45:32.008590 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:45:32.008590 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 21:45:32.008590 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:45:32.008590 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:45:32.008590 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 21:45:32.008590 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 21:45:32.008590 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 21:45:32.008590 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 21:45:32.008590 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6442f189-c760-45c5-8313-4f1d3fe46461 could not be found. May 19 21:45:32.008590 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:45:32.010206 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-a960ebd4-f150-4b03-8773-00c2d8724b41 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Returning 404 to user: Instance 6442f189-c760-45c5-8313-4f1d3fe46461 could not be found. {{(pid=124349) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 21:45:32.010206 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-a960ebd4-f150-4b03-8773-00c2d8724b41 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] 10.222.0.65 "DELETE /compute/v2.1/servers/6442f189-c760-45c5-8313-4f1d3fe46461" status: 404 len: 111 microversion: 2.1 time: 0.036465 May 19 21:45:32.010206 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 482/974] 10.222.0.65 () {58 vars in 1238 bytes} [Thu May 19 21:45:31 2022] DELETE /compute/v2.1/servers/6442f189-c760-45c5-8313-4f1d3fe46461 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 21:45:32.014971 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-f8cc3d8b-344e-45ab-8a19-f020de6d771f tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:45:32.015580 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-f8cc3d8b-344e-45ab-8a19-f020de6d771f tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] [instance: 6442f189-c760-45c5-8313-4f1d3fe46461] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:45:32.021895 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f8cc3d8b-344e-45ab-8a19-f020de6d771f tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:45:32.022377 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f8cc3d8b-344e-45ab-8a19-f020de6d771f tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:45:32.023128 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f8cc3d8b-344e-45ab-8a19-f020de6d771f tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:45:32.023555 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f8cc3d8b-344e-45ab-8a19-f020de6d771f tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:45:32.040291 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.wsgi [None req-f8cc3d8b-344e-45ab-8a19-f020de6d771f tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] HTTP exception thrown: Instance 6442f189-c760-45c5-8313-4f1d3fe46461 could not be found. May 19 21:45:32.041835 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-f8cc3d8b-344e-45ab-8a19-f020de6d771f tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Request method failure captured: May 19 21:45:32.041835 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: request: GET /compute/v2.1/servers/6442f189-c760-45c5-8313-4f1d3fe46461 HTTP/1.1 May 19 21:45:32.041835 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Accept: application/json May 19 21:45:32.041835 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Accept-Encoding: identity May 19 21:45:32.041835 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Connection: close May 19 21:45:32.041835 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Content-Length: 0 May 19 21:45:32.041835 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Content-Type: application/json May 19 21:45:32.041835 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Host: 10.222.0.65 May 19 21:45:32.041835 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Openstack-System-Scope: None May 19 21:45:32.041835 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: User-Agent: python-urllib3/1.26.9 May 19 21:45:32.041835 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Auth-Token: gAAAAABihrfGK__DJuYwI5JFz7AYjoJ5gQpF1NeU2sp6GL9Qm9r1qL-i4GqBqmgs0jr4aqzBtoAgR05QaRiKLd4CAlxsJ2Ka7-M6bw7EJFeb6jfz-DF94qKLiELFhcDH5F0ovdWhowq_VcBc9NHl4Po_3pwvmY2AqKHahlmuAmlCLH3bMLBrU08 May 19 21:45:32.041835 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Domain-Id: None May 19 21:45:32.041835 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Domain-Name: None May 19 21:45:32.041835 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Identity-Status: Confirmed May 19 21:45:32.041835 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Is-Admin-Project: True May 19 21:45:32.041835 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Project-Domain-Id: default May 19 21:45:32.041835 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Project-Domain-Name: Default May 19 21:45:32.041835 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Project-Id: 4951b93f86e1485692a4aae7b9ece8f6 May 19 21:45:32.041835 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Project-Name: tempest-TestVolumeBootPattern-2027905667 May 19 21:45:32.041835 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Role: reader,member May 19 21:45:32.041835 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Roles: reader,member May 19 21:45:32.043507 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/4951b93f86e1485692a4aae7b9ece8f6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/4951b93f86e1485692a4aae7b9ece8f6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_4951b93f86e1485692a4aae7b9ece8f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/4951b93f86e1485692a4aae7b9ece8f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}] May 19 21:45:32.043507 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Tenant: tempest-TestVolumeBootPattern-2027905667 May 19 21:45:32.043507 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Tenant-Id: 4951b93f86e1485692a4aae7b9ece8f6 May 19 21:45:32.043507 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Tenant-Name: tempest-TestVolumeBootPattern-2027905667 May 19 21:45:32.043507 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-User: tempest-TestVolumeBootPattern-2027905667-project May 19 21:45:32.043507 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-User-Domain-Id: default May 19 21:45:32.043507 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-User-Domain-Name: Default May 19 21:45:32.043507 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-User-Id: 0a58f82117ab437cab5607c204c86547 May 19 21:45:32.043507 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-User-Name: tempest-TestVolumeBootPattern-2027905667-project May 19 21:45:32.043507 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: method: > May 19 21:45:32.043507 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: exception: Instance 6442f189-c760-45c5-8313-4f1d3fe46461 could not be found. May 19 21:45:32.043507 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: action_args: {'id': '6442f189-c760-45c5-8313-4f1d3fe46461'} May 19 21:45:32.044318 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 21:45:32.044318 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:45:32.044318 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 21:45:32.044318 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 21:45:32.044318 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 21:45:32.044318 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 21:45:32.044318 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 21:45:32.044318 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 21:45:32.044318 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 21:45:32.044318 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 21:45:32.044318 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6442f189-c760-45c5-8313-4f1d3fe46461 could not be found. May 19 21:45:32.044318 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi May 19 21:45:32.044318 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 21:45:32.044318 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi May 19 21:45:32.044318 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:45:32.044318 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 21:45:32.044318 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 21:45:32.044318 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 21:45:32.044318 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 21:45:32.044318 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 21:45:32.045964 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 21:45:32.045964 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 21:45:32.045964 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 21:45:32.045964 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 21:45:32.045964 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 21:45:32.045964 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 21:45:32.045964 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 21:45:32.045964 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6442f189-c760-45c5-8313-4f1d3fe46461 could not be found. May 19 21:45:32.045964 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi May 19 21:45:32.045964 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 21:45:32.045964 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi May 19 21:45:32.045964 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:45:32.045964 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 21:45:32.045964 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 21:45:32.045964 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 21:45:32.045964 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 21:45:32.045964 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6442f189-c760-45c5-8313-4f1d3fe46461 could not be found. May 19 21:45:32.045964 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi May 19 21:45:32.047270 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-f8cc3d8b-344e-45ab-8a19-f020de6d771f tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Returning 404 to user: Instance 6442f189-c760-45c5-8313-4f1d3fe46461 could not be found. {{(pid=124350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 21:45:32.047270 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-f8cc3d8b-344e-45ab-8a19-f020de6d771f tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] 10.222.0.65 "GET /compute/v2.1/servers/6442f189-c760-45c5-8313-4f1d3fe46461" status: 404 len: 111 microversion: 2.1 time: 0.032468 May 19 21:45:32.047270 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 493/975] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:45:32 2022] GET /compute/v2.1/servers/6442f189-c760-45c5-8313-4f1d3fe46461 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 21:45:33.388432 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-50cd3bf6-1a17-43ae-a4f1-d84dfefd9916 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] Calling method '.version_select at 0x7fe363689310>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:45:33.417026 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-50cd3bf6-1a17-43ae-a4f1-d84dfefd9916 tempest-TestVolumeBootPattern-2027905667 tempest-TestVolumeBootPattern-2027905667-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2053369052" status: 202 len: 0 microversion: 2.1 time: 0.031613 May 19 21:45:33.417026 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 483/976] 10.222.0.65 () {58 vars in 1262 bytes} [Thu May 19 21:45:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2053369052 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 21:45:51.582530 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-fdd204bf-d7ac-468b-a043-1a5064b9e46a tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:45:51.583357 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-fdd204bf-d7ac-468b-a043-1a5064b9e46a tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] [instance: 2d071024-fffe-422f-9730-0f429f40221b] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:45:51.586882 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=2 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:45:51.587651 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:45:51.594845 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-fdd204bf-d7ac-468b-a043-1a5064b9e46a tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:45:51.595313 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-fdd204bf-d7ac-468b-a043-1a5064b9e46a tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:45:51.596085 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-fdd204bf-d7ac-468b-a043-1a5064b9e46a tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:45:51.596519 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-fdd204bf-d7ac-468b-a043-1a5064b9e46a tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:45:51.624405 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-fdd204bf-d7ac-468b-a043-1a5064b9e46a tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] 10.222.0.65 "GET /compute/v2.1/servers/2d071024-fffe-422f-9730-0f429f40221b/ips" status: 200 len: 148 microversion: 2.1 time: 0.047825 May 19 21:45:51.624987 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 494/977] 10.222.0.65 () {58 vars in 1247 bytes} [Thu May 19 21:45:51 2022] GET /compute/v2.1/servers/2d071024-fffe-422f-9730-0f429f40221b/ips => generated 148 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 21:45:53.009471 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-3a9c8718-1ea0-4bcc-958c-d972c7644347 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a03f9411-4a63-48f1-984b-c55e5ab165ee"}} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:45:53.011290 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-3a9c8718-1ea0-4bcc-958c-d972c7644347 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] [instance: 2d071024-fffe-422f-9730-0f429f40221b] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:45:53.016866 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_cell1:SELECT=24 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:45:53.017901 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_api:SELECT=19,nova_api:DELETE=1 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:45:53.027694 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-3a9c8718-1ea0-4bcc-958c-d972c7644347 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:45:53.028344 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-3a9c8718-1ea0-4bcc-958c-d972c7644347 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:45:53.029543 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-3a9c8718-1ea0-4bcc-958c-d972c7644347 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:45:53.030164 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-3a9c8718-1ea0-4bcc-958c-d972c7644347 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:45:53.311728 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-3a9c8718-1ea0-4bcc-958c-d972c7644347 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] 10.222.0.65 "POST /compute/v2.1/servers/2d071024-fffe-422f-9730-0f429f40221b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.308985 May 19 21:45:53.312820 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 484/978] 10.222.0.65 () {60 vars in 1322 bytes} [Thu May 19 21:45:53 2022] POST /compute/v2.1/servers/2d071024-fffe-422f-9730-0f429f40221b/os-volume_attachments => generated 194 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 21:46:00.859006 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-8aefd939-5ab2-4014-8f5c-fe5250f35c28 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Action: 'create', calling method: .version_select at 0x7fe363738550>, body: {"keypair": {"name": "tempest-keypair-1200629146", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF/KdgDPst/YwQryHoTvTh3WPIHPBeFECNZV1psdhmVFGYegU85f7WqjcoP7yNDiNGz5iXRaLgwPLONv0D0pWrOtleDSdCyun7F1xJ8FTc78nS1N92QQ+JCVKUrpjVSsaQ=="}} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:46:00.882033 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.quota [None req-8aefd939-5ab2-4014-8f5c-fe5250f35c28 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Getting quotas for project 9a4ad8679d5446b591d4083529f992cc. Resources: {'key_pairs'} {{(pid=124350) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 21:46:00.886202 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.quota [None req-8aefd939-5ab2-4014-8f5c-fe5250f35c28 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Getting quotas for user b9bd7a1a0e804d23aaa68153549672c9 and project 9a4ad8679d5446b591d4083529f992cc. Resources: {'key_pairs'} {{(pid=124350) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 21:46:00.911183 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-8aefd939-5ab2-4014-8f5c-fe5250f35c28 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.058367 May 19 21:46:00.911844 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 495/979] 10.222.0.65 () {60 vars in 1158 bytes} [Thu May 19 21:46:00 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 21:46:02.338229 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-7d8d8158-1aaf-4a6d-91c9-5c77f69465bb tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1904747152", "imageRef": "a874457a-f8a8-46f6-bdcc-1fa632a0d3c0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c2dc31bc-9d9f-4b3a-a6c3-4de0dc53e03d"}], "security_groups": [{"name": "tempest-securitygroup--1190069816"}], "key_name": "tempest-keypair-1200629146", "user_data": "}} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:46:02.456840 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.network.neutron [None req-7d8d8158-1aaf-4a6d-91c9-5c77f69465bb tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] validate_networks() for [('c2dc31bc-9d9f-4b3a-a6c3-4de0dc53e03d', None, None, None, None, None)] {{(pid=124349) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 19 21:46:02.964489 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.virt.hardware [None req-7d8d8158-1aaf-4a6d-91c9-5c77f69465bb tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Flavor limits 0:0:0 {{(pid=124349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 21:46:02.964916 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.virt.hardware [None req-7d8d8158-1aaf-4a6d-91c9-5c77f69465bb tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Image limits 0:0:0 {{(pid=124349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 21:46:02.965391 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.virt.hardware [None req-7d8d8158-1aaf-4a6d-91c9-5c77f69465bb tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Flavor pref 0:0:0 {{(pid=124349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 21:46:02.965800 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.virt.hardware [None req-7d8d8158-1aaf-4a6d-91c9-5c77f69465bb tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Image pref 0:0:0 {{(pid=124349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 21:46:02.966220 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.virt.hardware [None req-7d8d8158-1aaf-4a6d-91c9-5c77f69465bb tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 21:46:02.976139 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-7d8d8158-1aaf-4a6d-91c9-5c77f69465bb tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:46:02.976586 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-7d8d8158-1aaf-4a6d-91c9-5c77f69465bb tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:46:02.977395 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-7d8d8158-1aaf-4a6d-91c9-5c77f69465bb tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:46:02.977830 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-7d8d8158-1aaf-4a6d-91c9-5c77f69465bb tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:46:02.995475 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.quota [None req-7d8d8158-1aaf-4a6d-91c9-5c77f69465bb tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Getting quotas for project 9a4ad8679d5446b591d4083529f992cc. Resources: {'ram', 'cores', 'instances'} {{(pid=124349) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 21:46:02.999928 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.quota [None req-7d8d8158-1aaf-4a6d-91c9-5c77f69465bb tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Getting quotas for user b9bd7a1a0e804d23aaa68153549672c9 and project 9a4ad8679d5446b591d4083529f992cc. Resources: {'ram', 'cores', 'instances'} {{(pid=124349) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 21:46:03.012811 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-7d8d8158-1aaf-4a6d-91c9-5c77f69465bb tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Going to run 1 instances... {{(pid=124349) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 21:46:03.015217 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-7d8d8158-1aaf-4a6d-91c9-5c77f69465bb tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] [instance: b9d58902-c539-4c3e-8a00-b1aeb2cb9c52] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a874457a-f8a8-46f6-bdcc-1fa632a0d3c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124349) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 21:46:03.073090 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-7d8d8158-1aaf-4a6d-91c9-5c77f69465bb tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.739584 May 19 21:46:03.074107 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 485/980] 10.222.0.65 () {60 vars in 1146 bytes} [Thu May 19 21:46:02 2022] POST /compute/v2.1/servers => generated 402 bytes in 741 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 21:46:03.085046 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-31197bd5-42c4-466f-889b-e20703485365 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:46:03.085813 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-31197bd5-42c4-466f-889b-e20703485365 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] [instance: b9d58902-c539-4c3e-8a00-b1aeb2cb9c52] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:46:03.087906 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell1:SELECT=4 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:46:03.156445 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-31197bd5-42c4-466f-889b-e20703485365 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9bd7a1a0e804d23aaa68153549672c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4ad8679d5446b591d4083529f992cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:46:03.164035 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-31197bd5-42c4-466f-889b-e20703485365 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] 10.222.0.65 "GET /compute/v2.1/servers/b9d58902-c539-4c3e-8a00-b1aeb2cb9c52" status: 200 len: 1242 microversion: 2.1 time: 0.083526 May 19 21:46:03.164609 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 496/981] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:46:03 2022] GET /compute/v2.1/servers/b9d58902-c539-4c3e-8a00-b1aeb2cb9c52 => generated 1242 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:46:04.181930 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-e856371a-e60d-473f-8c9c-17539babc028 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:46:04.182509 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-e856371a-e60d-473f-8c9c-17539babc028 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] [instance: b9d58902-c539-4c3e-8a00-b1aeb2cb9c52] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:46:04.189510 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e856371a-e60d-473f-8c9c-17539babc028 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:46:04.190320 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e856371a-e60d-473f-8c9c-17539babc028 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:46:04.191091 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e856371a-e60d-473f-8c9c-17539babc028 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:46:04.191556 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e856371a-e60d-473f-8c9c-17539babc028 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:46:04.256349 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-e856371a-e60d-473f-8c9c-17539babc028 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9bd7a1a0e804d23aaa68153549672c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4ad8679d5446b591d4083529f992cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:46:04.264627 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-e856371a-e60d-473f-8c9c-17539babc028 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] 10.222.0.65 "GET /compute/v2.1/servers/b9d58902-c539-4c3e-8a00-b1aeb2cb9c52" status: 200 len: 1294 microversion: 2.1 time: 0.087238 May 19 21:46:04.265958 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 486/982] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:46:04 2022] GET /compute/v2.1/servers/b9d58902-c539-4c3e-8a00-b1aeb2cb9c52 => generated 1294 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:46:05.283127 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-901a6d68-5e34-4c70-849c-a6fec5da70ec tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:46:05.283746 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-901a6d68-5e34-4c70-849c-a6fec5da70ec tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] [instance: b9d58902-c539-4c3e-8a00-b1aeb2cb9c52] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:46:05.290368 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-901a6d68-5e34-4c70-849c-a6fec5da70ec tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:46:05.290815 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-901a6d68-5e34-4c70-849c-a6fec5da70ec tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:46:05.291589 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-901a6d68-5e34-4c70-849c-a6fec5da70ec tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:46:05.292020 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-901a6d68-5e34-4c70-849c-a6fec5da70ec tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:46:05.462779 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-901a6d68-5e34-4c70-849c-a6fec5da70ec tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9bd7a1a0e804d23aaa68153549672c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4ad8679d5446b591d4083529f992cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:46:05.470861 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-901a6d68-5e34-4c70-849c-a6fec5da70ec tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] 10.222.0.65 "GET /compute/v2.1/servers/b9d58902-c539-4c3e-8a00-b1aeb2cb9c52" status: 200 len: 1368 microversion: 2.1 time: 0.192029 May 19 21:46:05.471455 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 497/983] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:46:05 2022] GET /compute/v2.1/servers/b9d58902-c539-4c3e-8a00-b1aeb2cb9c52 => generated 1368 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:46:05.878644 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [req-1ad74a84-e05f-46b6-bd40-90791b9212b0 req-677668b7-e6e1-48fa-ad17-9dc0b22d9f93 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9d58902-c539-4c3e-8a00-b1aeb2cb9c52", "tag": "691d8469-56d2-4532-96c0-84e3812e6839"}]} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:46:05.893099 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-1ad74a84-e05f-46b6-bd40-90791b9212b0 req-677668b7-e6e1-48fa-ad17-9dc0b22d9f93 service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:46:05.894104 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-1ad74a84-e05f-46b6-bd40-90791b9212b0 req-677668b7-e6e1-48fa-ad17-9dc0b22d9f93 service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:46:05.920698 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.compute.server_external_events [req-1ad74a84-e05f-46b6-bd40-90791b9212b0 req-677668b7-e6e1-48fa-ad17-9dc0b22d9f93 service nova] Creating event network-changed:691d8469-56d2-4532-96c0-84e3812e6839 for instance b9d58902-c539-4c3e-8a00-b1aeb2cb9c52 on hv-cinder-83563 May 19 21:46:05.927224 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [req-1ad74a84-e05f-46b6-bd40-90791b9212b0 req-677668b7-e6e1-48fa-ad17-9dc0b22d9f93 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053163 May 19 21:46:05.927965 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 487/984] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 21:46:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 21:46:06.490272 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-96aa0227-a976-4636-8c49-e6da218d7671 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:46:06.490941 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-96aa0227-a976-4636-8c49-e6da218d7671 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] [instance: b9d58902-c539-4c3e-8a00-b1aeb2cb9c52] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:46:06.497946 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-96aa0227-a976-4636-8c49-e6da218d7671 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:46:06.498430 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-96aa0227-a976-4636-8c49-e6da218d7671 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:46:06.499198 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-96aa0227-a976-4636-8c49-e6da218d7671 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:46:06.499626 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-96aa0227-a976-4636-8c49-e6da218d7671 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:46:06.634573 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-96aa0227-a976-4636-8c49-e6da218d7671 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9bd7a1a0e804d23aaa68153549672c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4ad8679d5446b591d4083529f992cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:46:06.642511 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-96aa0227-a976-4636-8c49-e6da218d7671 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] 10.222.0.65 "GET /compute/v2.1/servers/b9d58902-c539-4c3e-8a00-b1aeb2cb9c52" status: 200 len: 1368 microversion: 2.1 time: 0.156846 May 19 21:46:06.643090 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 498/985] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:46:06 2022] GET /compute/v2.1/servers/b9d58902-c539-4c3e-8a00-b1aeb2cb9c52 => generated 1368 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:46:07.662976 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-67f0b47a-5540-442a-993a-ce801b7822ce tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:46:07.663699 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-67f0b47a-5540-442a-993a-ce801b7822ce tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] [instance: b9d58902-c539-4c3e-8a00-b1aeb2cb9c52] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:46:07.670697 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-67f0b47a-5540-442a-993a-ce801b7822ce tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:46:07.671140 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-67f0b47a-5540-442a-993a-ce801b7822ce tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:46:07.671900 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-67f0b47a-5540-442a-993a-ce801b7822ce tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:46:07.672327 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-67f0b47a-5540-442a-993a-ce801b7822ce tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:46:07.815611 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-67f0b47a-5540-442a-993a-ce801b7822ce tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9bd7a1a0e804d23aaa68153549672c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4ad8679d5446b591d4083529f992cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:46:07.824439 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-67f0b47a-5540-442a-993a-ce801b7822ce tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] 10.222.0.65 "GET /compute/v2.1/servers/b9d58902-c539-4c3e-8a00-b1aeb2cb9c52" status: 200 len: 1368 microversion: 2.1 time: 0.166256 May 19 21:46:07.825005 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 488/986] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:46:07 2022] GET /compute/v2.1/servers/b9d58902-c539-4c3e-8a00-b1aeb2cb9c52 => generated 1368 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:46:08.843534 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-17c457de-5a64-4998-834a-5a1fa156025e tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:46:08.844244 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-17c457de-5a64-4998-834a-5a1fa156025e tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] [instance: b9d58902-c539-4c3e-8a00-b1aeb2cb9c52] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:46:08.853021 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-17c457de-5a64-4998-834a-5a1fa156025e tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:46:08.853863 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-17c457de-5a64-4998-834a-5a1fa156025e tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:46:08.854301 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-17c457de-5a64-4998-834a-5a1fa156025e tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:46:08.854747 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-17c457de-5a64-4998-834a-5a1fa156025e tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:46:09.003401 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-17c457de-5a64-4998-834a-5a1fa156025e tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9bd7a1a0e804d23aaa68153549672c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4ad8679d5446b591d4083529f992cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:46:09.012704 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-17c457de-5a64-4998-834a-5a1fa156025e tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] 10.222.0.65 "GET /compute/v2.1/servers/b9d58902-c539-4c3e-8a00-b1aeb2cb9c52" status: 200 len: 1368 microversion: 2.1 time: 0.174620 May 19 21:46:09.013547 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 499/987] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:46:08 2022] GET /compute/v2.1/servers/b9d58902-c539-4c3e-8a00-b1aeb2cb9c52 => generated 1368 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:46:10.031827 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-c6252841-4e92-429c-8a7a-e8c6cb9c850f tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:46:10.032462 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-c6252841-4e92-429c-8a7a-e8c6cb9c850f tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] [instance: b9d58902-c539-4c3e-8a00-b1aeb2cb9c52] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:46:10.039264 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c6252841-4e92-429c-8a7a-e8c6cb9c850f tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:46:10.039704 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c6252841-4e92-429c-8a7a-e8c6cb9c850f tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:46:10.040718 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c6252841-4e92-429c-8a7a-e8c6cb9c850f tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:46:10.041147 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c6252841-4e92-429c-8a7a-e8c6cb9c850f tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:46:10.181602 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-c6252841-4e92-429c-8a7a-e8c6cb9c850f tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9bd7a1a0e804d23aaa68153549672c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4ad8679d5446b591d4083529f992cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:46:10.192361 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-c6252841-4e92-429c-8a7a-e8c6cb9c850f tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] 10.222.0.65 "GET /compute/v2.1/servers/b9d58902-c539-4c3e-8a00-b1aeb2cb9c52" status: 200 len: 1368 microversion: 2.1 time: 0.165902 May 19 21:46:10.192925 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 489/988] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:46:10 2022] GET /compute/v2.1/servers/b9d58902-c539-4c3e-8a00-b1aeb2cb9c52 => generated 1368 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:46:11.187581 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [req-0797bb75-2a89-4b2a-ae30-81c4637d6c31 req-9cdb1438-749f-4dc9-8aa8-a8535b50a62f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9d58902-c539-4c3e-8a00-b1aeb2cb9c52", "name": "network-vif-plugged", "status": "completed", "tag": "691d8469-56d2-4532-96c0-84e3812e6839"}]} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:46:11.198534 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-0797bb75-2a89-4b2a-ae30-81c4637d6c31 req-9cdb1438-749f-4dc9-8aa8-a8535b50a62f service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:46:11.199992 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-0797bb75-2a89-4b2a-ae30-81c4637d6c31 req-9cdb1438-749f-4dc9-8aa8-a8535b50a62f service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:46:11.210172 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-6eab340b-e14d-4357-a1c5-761efec4c785 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:46:11.213865 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-6eab340b-e14d-4357-a1c5-761efec4c785 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] [instance: b9d58902-c539-4c3e-8a00-b1aeb2cb9c52] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:46:11.218290 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-6eab340b-e14d-4357-a1c5-761efec4c785 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:46:11.219608 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-6eab340b-e14d-4357-a1c5-761efec4c785 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:46:11.220549 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-6eab340b-e14d-4357-a1c5-761efec4c785 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:46:11.221024 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-6eab340b-e14d-4357-a1c5-761efec4c785 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:46:11.222004 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.compute.server_external_events [req-0797bb75-2a89-4b2a-ae30-81c4637d6c31 req-9cdb1438-749f-4dc9-8aa8-a8535b50a62f service nova] Creating event network-vif-plugged:691d8469-56d2-4532-96c0-84e3812e6839 for instance b9d58902-c539-4c3e-8a00-b1aeb2cb9c52 on hv-cinder-83563 May 19 21:46:11.227823 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [req-0797bb75-2a89-4b2a-ae30-81c4637d6c31 req-9cdb1438-749f-4dc9-8aa8-a8535b50a62f service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043696 May 19 21:46:11.228766 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 500/989] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 21:46:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 21:46:11.416147 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-6eab340b-e14d-4357-a1c5-761efec4c785 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9bd7a1a0e804d23aaa68153549672c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4ad8679d5446b591d4083529f992cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:46:11.426872 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-6eab340b-e14d-4357-a1c5-761efec4c785 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] 10.222.0.65 "GET /compute/v2.1/servers/b9d58902-c539-4c3e-8a00-b1aeb2cb9c52" status: 200 len: 1368 microversion: 2.1 time: 0.220494 May 19 21:46:11.427383 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 490/990] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:46:11 2022] GET /compute/v2.1/servers/b9d58902-c539-4c3e-8a00-b1aeb2cb9c52 => generated 1368 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:46:12.445763 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-fef43d22-da3f-480b-ab2c-9eddd5310f69 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:46:12.446527 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-fef43d22-da3f-480b-ab2c-9eddd5310f69 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] [instance: b9d58902-c539-4c3e-8a00-b1aeb2cb9c52] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:46:12.454790 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-fef43d22-da3f-480b-ab2c-9eddd5310f69 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:46:12.455233 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-fef43d22-da3f-480b-ab2c-9eddd5310f69 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:46:12.456010 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-fef43d22-da3f-480b-ab2c-9eddd5310f69 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:46:12.456438 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-fef43d22-da3f-480b-ab2c-9eddd5310f69 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:46:12.597829 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-fef43d22-da3f-480b-ab2c-9eddd5310f69 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9bd7a1a0e804d23aaa68153549672c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4ad8679d5446b591d4083529f992cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:46:12.606185 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-fef43d22-da3f-480b-ab2c-9eddd5310f69 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] 10.222.0.65 "GET /compute/v2.1/servers/b9d58902-c539-4c3e-8a00-b1aeb2cb9c52" status: 200 len: 1368 microversion: 2.1 time: 0.164889 May 19 21:46:12.606876 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 501/991] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:46:12 2022] GET /compute/v2.1/servers/b9d58902-c539-4c3e-8a00-b1aeb2cb9c52 => generated 1368 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:46:13.623787 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-be5dee64-1840-473c-9da4-c37e32c39a20 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:46:13.624402 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-be5dee64-1840-473c-9da4-c37e32c39a20 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] [instance: b9d58902-c539-4c3e-8a00-b1aeb2cb9c52] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:46:13.626866 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_cell0:SELECT=2 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:46:13.627536 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_cell0:SELECT=6 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:46:13.633977 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-be5dee64-1840-473c-9da4-c37e32c39a20 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:46:13.634463 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-be5dee64-1840-473c-9da4-c37e32c39a20 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:46:13.635377 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-be5dee64-1840-473c-9da4-c37e32c39a20 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:46:13.635921 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-be5dee64-1840-473c-9da4-c37e32c39a20 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:46:13.786493 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-be5dee64-1840-473c-9da4-c37e32c39a20 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9bd7a1a0e804d23aaa68153549672c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4ad8679d5446b591d4083529f992cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:46:13.795055 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-be5dee64-1840-473c-9da4-c37e32c39a20 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] 10.222.0.65 "GET /compute/v2.1/servers/b9d58902-c539-4c3e-8a00-b1aeb2cb9c52" status: 200 len: 1558 microversion: 2.1 time: 0.175162 May 19 21:46:13.798724 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 491/992] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:46:13 2022] GET /compute/v2.1/servers/b9d58902-c539-4c3e-8a00-b1aeb2cb9c52 => generated 1558 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:46:13.812498 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-77cace34-fc0a-4372-89bf-fc23133ea051 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:46:13.813145 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-77cace34-fc0a-4372-89bf-fc23133ea051 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] [instance: b9d58902-c539-4c3e-8a00-b1aeb2cb9c52] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:46:13.815432 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell0:SELECT=6 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:46:13.821953 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-77cace34-fc0a-4372-89bf-fc23133ea051 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:46:13.822519 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-77cace34-fc0a-4372-89bf-fc23133ea051 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:46:13.823304 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-77cace34-fc0a-4372-89bf-fc23133ea051 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:46:13.823741 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-77cace34-fc0a-4372-89bf-fc23133ea051 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:46:13.910431 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-77cace34-fc0a-4372-89bf-fc23133ea051 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] 10.222.0.65 "GET /compute/v2.1/servers/b9d58902-c539-4c3e-8a00-b1aeb2cb9c52/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.101966 May 19 21:46:13.911038 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 502/993] 10.222.0.65 () {58 vars in 1274 bytes} [Thu May 19 21:46:13 2022] GET /compute/v2.1/servers/b9d58902-c539-4c3e-8a00-b1aeb2cb9c52/os-interface => generated 285 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 21:46:14.907082 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [req-edb9c9f4-4187-46d2-878e-a21610728472 req-46889cf5-5985-4285-ad3a-a08c45c26c97 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9d58902-c539-4c3e-8a00-b1aeb2cb9c52", "tag": "691d8469-56d2-4532-96c0-84e3812e6839"}]} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:46:14.916284 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-edb9c9f4-4187-46d2-878e-a21610728472 req-46889cf5-5985-4285-ad3a-a08c45c26c97 service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:46:14.916755 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-edb9c9f4-4187-46d2-878e-a21610728472 req-46889cf5-5985-4285-ad3a-a08c45c26c97 service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:46:14.931578 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.compute.server_external_events [req-edb9c9f4-4187-46d2-878e-a21610728472 req-46889cf5-5985-4285-ad3a-a08c45c26c97 service nova] Creating event network-changed:691d8469-56d2-4532-96c0-84e3812e6839 for instance b9d58902-c539-4c3e-8a00-b1aeb2cb9c52 on hv-cinder-83563 May 19 21:46:14.937093 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [req-edb9c9f4-4187-46d2-878e-a21610728472 req-46889cf5-5985-4285-ad3a-a08c45c26c97 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033925 May 19 21:46:14.938083 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 492/994] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 21:46:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 21:47:13.360939 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 21:47:13.361522 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Thu May 19 21:47:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 19 21:47:30.043647 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:47:30.044476 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell1:SELECT=30 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:47:30.050027 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-c56e3806-0500-46cb-9d0a-b980844e3946 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:47:30.050776 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-c56e3806-0500-46cb-9d0a-b980844e3946 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] [instance: b9d58902-c539-4c3e-8a00-b1aeb2cb9c52] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:47:30.060736 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c56e3806-0500-46cb-9d0a-b980844e3946 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:47:30.061674 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c56e3806-0500-46cb-9d0a-b980844e3946 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:47:30.062839 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c56e3806-0500-46cb-9d0a-b980844e3946 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:47:30.063419 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c56e3806-0500-46cb-9d0a-b980844e3946 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:47:30.091197 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-c56e3806-0500-46cb-9d0a-b980844e3946 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] 10.222.0.65 "GET /compute/v2.1/servers/b9d58902-c539-4c3e-8a00-b1aeb2cb9c52/ips" status: 200 len: 149 microversion: 2.1 time: 0.050093 May 19 21:47:30.091782 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 503/995] 10.222.0.65 () {58 vars in 1247 bytes} [Thu May 19 21:47:30 2022] GET /compute/v2.1/servers/b9d58902-c539-4c3e-8a00-b1aeb2cb9c52/ips => generated 149 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 21:47:30.100981 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:47:30.102011 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:47:30.106895 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-fdcc864d-49c3-41c2-baa9-e8acd038545c tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a03f9411-4a63-48f1-984b-c55e5ab165ee"}} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:47:30.107990 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-fdcc864d-49c3-41c2-baa9-e8acd038545c tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] [instance: b9d58902-c539-4c3e-8a00-b1aeb2cb9c52] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:47:30.116160 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-fdcc864d-49c3-41c2-baa9-e8acd038545c tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:47:30.116597 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-fdcc864d-49c3-41c2-baa9-e8acd038545c tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:47:30.117357 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-fdcc864d-49c3-41c2-baa9-e8acd038545c tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:47:30.117777 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-fdcc864d-49c3-41c2-baa9-e8acd038545c tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:47:30.413295 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.wsgi [None req-fdcc864d-49c3-41c2-baa9-e8acd038545c tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] HTTP exception thrown: Invalid volume: volume a03f9411-4a63-48f1-984b-c55e5ab165ee is already attached to instances: 2d071024-fffe-422f-9730-0f429f40221b May 19 21:47:30.415924 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-fdcc864d-49c3-41c2-baa9-e8acd038545c tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Request method failure captured: May 19 21:47:30.415924 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: request: POST /compute/v2.1/servers/b9d58902-c539-4c3e-8a00-b1aeb2cb9c52/os-volume_attachments HTTP/1.1 May 19 21:47:30.415924 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Accept: application/json May 19 21:47:30.415924 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Accept-Encoding: identity May 19 21:47:30.415924 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Connection: close May 19 21:47:30.415924 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Content-Length: 74 May 19 21:47:30.415924 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Content-Type: application/json May 19 21:47:30.415924 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Host: 10.222.0.65 May 19 21:47:30.415924 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Openstack-System-Scope: None May 19 21:47:30.415924 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: User-Agent: python-urllib3/1.26.9 May 19 21:47:30.415924 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Auth-Token: gAAAAABihro0hjkJU9dn5H_V0BsW6Kiuc0LK2zzds0zMxBbjGHXtL1t0ZqjSlGNcltxwXHoc07BXy5_tlLdRemOLc3ACSGx6_UHrVglb4Wh1urAO678uN1i0U1kqAvWHY9-SCVABYPa39QKPrM5KIO_1WgzSamgvkXnJsmlc1efhwz24mY37XWk May 19 21:47:30.415924 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Domain-Id: None May 19 21:47:30.415924 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Domain-Name: None May 19 21:47:30.415924 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Identity-Status: Confirmed May 19 21:47:30.415924 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Is-Admin-Project: True May 19 21:47:30.415924 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Project-Domain-Id: default May 19 21:47:30.415924 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Project-Domain-Name: Default May 19 21:47:30.415924 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Project-Id: 9a4ad8679d5446b591d4083529f992cc May 19 21:47:30.415924 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Project-Name: tempest-AttachVolumeNegativeTest-1262812511 May 19 21:47:30.415924 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Role: reader,member May 19 21:47:30.415924 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Roles: reader,member May 19 21:47:30.418229 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/9a4ad8679d5446b591d4083529f992cc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/9a4ad8679d5446b591d4083529f992cc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_9a4ad8679d5446b591d4083529f992cc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/9a4ad8679d5446b591d4083529f992cc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}] May 19 21:47:30.418229 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Tenant: tempest-AttachVolumeNegativeTest-1262812511 May 19 21:47:30.418229 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Tenant-Id: 9a4ad8679d5446b591d4083529f992cc May 19 21:47:30.418229 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1262812511 May 19 21:47:30.418229 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-User: tempest-AttachVolumeNegativeTest-1262812511-project May 19 21:47:30.418229 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-User-Domain-Id: default May 19 21:47:30.418229 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-User-Domain-Name: Default May 19 21:47:30.418229 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-User-Id: b9bd7a1a0e804d23aaa68153549672c9 May 19 21:47:30.418229 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-User-Name: tempest-AttachVolumeNegativeTest-1262812511-project May 19 21:47:30.418229 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: May 19 21:47:30.418229 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: {"volumeAttachment": {"volumeId": "a03f9411-4a63-48f1-984b-c55e5ab165ee"}} May 19 21:47:30.418229 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: method: > May 19 21:47:30.419524 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: exception: Invalid volume: volume a03f9411-4a63-48f1-984b-c55e5ab165ee is already attached to instances: 2d071024-fffe-422f-9730-0f429f40221b May 19 21:47:30.419524 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: action_args: {'server_id': 'b9d58902-c539-4c3e-8a00-b1aeb2cb9c52', 'body': {'volumeAttachment': {'volumeId': 'a03f9411-4a63-48f1-984b-c55e5ab165ee'}}} May 19 21:47:30.419524 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 21:47:30.419524 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:47:30.419524 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 19 21:47:30.419524 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 19 21:47:30.419524 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 19 21:47:30.419524 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 19 21:47:30.419524 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 19 21:47:30.419524 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 19 21:47:30.419524 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 19 21:47:30.419524 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 19 21:47:30.419524 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 19 21:47:30.419524 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 19 21:47:30.419524 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume a03f9411-4a63-48f1-984b-c55e5ab165ee is already attached to instances: 2d071024-fffe-422f-9730-0f429f40221b May 19 21:47:30.419524 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:47:30.419524 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 21:47:30.419524 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:47:30.419524 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:47:30.421572 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 21:47:30.421572 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 21:47:30.421572 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 21:47:30.421572 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 21:47:30.421572 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 21:47:30.421572 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 21:47:30.421572 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 21:47:30.421572 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 21:47:30.421572 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 21:47:30.421572 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 21:47:30.421572 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 21:47:30.421572 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 21:47:30.421572 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 19 21:47:30.421572 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 19 21:47:30.421572 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume a03f9411-4a63-48f1-984b-c55e5ab165ee is already attached to instances: 2d071024-fffe-422f-9730-0f429f40221b May 19 21:47:30.421572 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:47:30.421572 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 21:47:30.421572 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:47:30.421572 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:47:30.421572 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 21:47:30.423615 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 21:47:30.423615 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 21:47:30.423615 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 21:47:30.423615 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume a03f9411-4a63-48f1-984b-c55e5ab165ee is already attached to instances: 2d071024-fffe-422f-9730-0f429f40221b May 19 21:47:30.423615 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:47:30.423615 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-fdcc864d-49c3-41c2-baa9-e8acd038545c tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Returning 400 to user: Invalid volume: volume a03f9411-4a63-48f1-984b-c55e5ab165ee is already attached to instances: 2d071024-fffe-422f-9730-0f429f40221b {{(pid=124349) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 21:47:30.423615 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-fdcc864d-49c3-41c2-baa9-e8acd038545c tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] 10.222.0.65 "POST /compute/v2.1/servers/b9d58902-c539-4c3e-8a00-b1aeb2cb9c52/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.319173 May 19 21:47:30.423615 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 493/996] 10.222.0.65 () {60 vars in 1322 bytes} [Thu May 19 21:47:30 2022] POST /compute/v2.1/servers/b9d58902-c539-4c3e-8a00-b1aeb2cb9c52/os-volume_attachments => generated 174 bytes in 321 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 19 21:47:30.430504 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-647ab574-d8a0-4488-90b2-8afabe42fe5b tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:47:30.430995 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-647ab574-d8a0-4488-90b2-8afabe42fe5b tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] [instance: b9d58902-c539-4c3e-8a00-b1aeb2cb9c52] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:47:30.437642 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-647ab574-d8a0-4488-90b2-8afabe42fe5b tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:47:30.438085 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-647ab574-d8a0-4488-90b2-8afabe42fe5b tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:47:30.438896 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-647ab574-d8a0-4488-90b2-8afabe42fe5b tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:47:30.439315 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-647ab574-d8a0-4488-90b2-8afabe42fe5b tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:47:30.464512 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-647ab574-d8a0-4488-90b2-8afabe42fe5b tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] [instance: b9d58902-c539-4c3e-8a00-b1aeb2cb9c52] Going to try to terminate instance {{(pid=124350) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 21:47:30.550545 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-647ab574-d8a0-4488-90b2-8afabe42fe5b tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] 10.222.0.65 "DELETE /compute/v2.1/servers/b9d58902-c539-4c3e-8a00-b1aeb2cb9c52" status: 204 len: 0 microversion: 2.1 time: 0.124772 May 19 21:47:30.551136 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 504/997] 10.222.0.65 () {58 vars in 1238 bytes} [Thu May 19 21:47:30 2022] DELETE /compute/v2.1/servers/b9d58902-c539-4c3e-8a00-b1aeb2cb9c52 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 21:47:30.559409 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-177d1bf0-283d-47e0-ad70-851de5036d77 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:47:30.560002 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-177d1bf0-283d-47e0-ad70-851de5036d77 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] [instance: b9d58902-c539-4c3e-8a00-b1aeb2cb9c52] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:47:30.567276 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-177d1bf0-283d-47e0-ad70-851de5036d77 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:47:30.567700 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-177d1bf0-283d-47e0-ad70-851de5036d77 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:47:30.568663 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-177d1bf0-283d-47e0-ad70-851de5036d77 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:47:30.568948 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-177d1bf0-283d-47e0-ad70-851de5036d77 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:47:30.710829 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-177d1bf0-283d-47e0-ad70-851de5036d77 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9bd7a1a0e804d23aaa68153549672c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4ad8679d5446b591d4083529f992cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:47:30.719345 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-177d1bf0-283d-47e0-ad70-851de5036d77 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] 10.222.0.65 "GET /compute/v2.1/servers/b9d58902-c539-4c3e-8a00-b1aeb2cb9c52" status: 200 len: 1682 microversion: 2.1 time: 0.163783 May 19 21:47:30.719909 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 494/998] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:47:30 2022] GET /compute/v2.1/servers/b9d58902-c539-4c3e-8a00-b1aeb2cb9c52 => generated 1682 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:47:31.738059 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-cc64b95a-6a59-47f8-8cd3-748cd291f865 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:47:31.738751 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-cc64b95a-6a59-47f8-8cd3-748cd291f865 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] [instance: b9d58902-c539-4c3e-8a00-b1aeb2cb9c52] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:47:31.746439 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cc64b95a-6a59-47f8-8cd3-748cd291f865 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:47:31.746880 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cc64b95a-6a59-47f8-8cd3-748cd291f865 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:47:31.747646 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cc64b95a-6a59-47f8-8cd3-748cd291f865 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:47:31.748071 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cc64b95a-6a59-47f8-8cd3-748cd291f865 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:47:31.961614 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-cc64b95a-6a59-47f8-8cd3-748cd291f865 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9bd7a1a0e804d23aaa68153549672c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4ad8679d5446b591d4083529f992cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:47:31.969872 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-cc64b95a-6a59-47f8-8cd3-748cd291f865 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] 10.222.0.65 "GET /compute/v2.1/servers/b9d58902-c539-4c3e-8a00-b1aeb2cb9c52" status: 200 len: 1682 microversion: 2.1 time: 0.236136 May 19 21:47:31.970456 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 505/999] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:47:31 2022] GET /compute/v2.1/servers/b9d58902-c539-4c3e-8a00-b1aeb2cb9c52 => generated 1682 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:47:32.987765 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-7533fcd6-126a-4c51-99b2-06ab4f9362a5 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:47:32.988440 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-7533fcd6-126a-4c51-99b2-06ab4f9362a5 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] [instance: b9d58902-c539-4c3e-8a00-b1aeb2cb9c52] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:47:32.995937 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-7533fcd6-126a-4c51-99b2-06ab4f9362a5 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:47:32.996384 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-7533fcd6-126a-4c51-99b2-06ab4f9362a5 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:47:32.997159 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-7533fcd6-126a-4c51-99b2-06ab4f9362a5 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:47:32.997592 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-7533fcd6-126a-4c51-99b2-06ab4f9362a5 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:47:33.090782 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-7533fcd6-126a-4c51-99b2-06ab4f9362a5 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9bd7a1a0e804d23aaa68153549672c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4ad8679d5446b591d4083529f992cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:47:33.098876 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-7533fcd6-126a-4c51-99b2-06ab4f9362a5 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] 10.222.0.65 "GET /compute/v2.1/servers/b9d58902-c539-4c3e-8a00-b1aeb2cb9c52" status: 200 len: 1614 microversion: 2.1 time: 0.115031 May 19 21:47:33.100086 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 495/1000] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:47:32 2022] GET /compute/v2.1/servers/b9d58902-c539-4c3e-8a00-b1aeb2cb9c52 => generated 1614 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:47:33.116720 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [req-f8396b41-cdfc-48ae-a1a9-83dfecf4c84d req-9aff8645-67d2-4a22-8c9b-1dc72282f044 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9d58902-c539-4c3e-8a00-b1aeb2cb9c52", "name": "network-vif-deleted", "tag": "691d8469-56d2-4532-96c0-84e3812e6839"}]} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:47:33.125829 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-f8396b41-cdfc-48ae-a1a9-83dfecf4c84d req-9aff8645-67d2-4a22-8c9b-1dc72282f044 service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:47:33.126288 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-f8396b41-cdfc-48ae-a1a9-83dfecf4c84d req-9aff8645-67d2-4a22-8c9b-1dc72282f044 service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:47:33.140715 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.compute.server_external_events [req-f8396b41-cdfc-48ae-a1a9-83dfecf4c84d req-9aff8645-67d2-4a22-8c9b-1dc72282f044 service nova] Creating event network-vif-deleted:691d8469-56d2-4532-96c0-84e3812e6839 for instance b9d58902-c539-4c3e-8a00-b1aeb2cb9c52 on hv-cinder-83563 May 19 21:47:33.146465 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [req-f8396b41-cdfc-48ae-a1a9-83dfecf4c84d req-9aff8645-67d2-4a22-8c9b-1dc72282f044 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044509 May 19 21:47:33.147072 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 506/1001] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 21:47:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 21:47:34.127429 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-92a102df-b395-4854-b42a-ce76db9e1da6 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:47:34.128509 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-92a102df-b395-4854-b42a-ce76db9e1da6 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] [instance: b9d58902-c539-4c3e-8a00-b1aeb2cb9c52] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:47:34.140060 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-92a102df-b395-4854-b42a-ce76db9e1da6 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:47:34.141152 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-92a102df-b395-4854-b42a-ce76db9e1da6 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:47:34.142040 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-92a102df-b395-4854-b42a-ce76db9e1da6 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:47:34.142505 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-92a102df-b395-4854-b42a-ce76db9e1da6 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:47:34.158414 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.wsgi [None req-92a102df-b395-4854-b42a-ce76db9e1da6 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] HTTP exception thrown: Instance b9d58902-c539-4c3e-8a00-b1aeb2cb9c52 could not be found. May 19 21:47:34.160012 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-92a102df-b395-4854-b42a-ce76db9e1da6 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Request method failure captured: May 19 21:47:34.160012 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: request: GET /compute/v2.1/servers/b9d58902-c539-4c3e-8a00-b1aeb2cb9c52 HTTP/1.1 May 19 21:47:34.160012 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Accept: application/json May 19 21:47:34.160012 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Accept-Encoding: identity May 19 21:47:34.160012 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Connection: close May 19 21:47:34.160012 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Content-Length: 0 May 19 21:47:34.160012 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Content-Type: application/json May 19 21:47:34.160012 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Host: 10.222.0.65 May 19 21:47:34.160012 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Openstack-System-Scope: None May 19 21:47:34.160012 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: User-Agent: python-urllib3/1.26.9 May 19 21:47:34.160012 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Auth-Token: gAAAAABihro0hjkJU9dn5H_V0BsW6Kiuc0LK2zzds0zMxBbjGHXtL1t0ZqjSlGNcltxwXHoc07BXy5_tlLdRemOLc3ACSGx6_UHrVglb4Wh1urAO678uN1i0U1kqAvWHY9-SCVABYPa39QKPrM5KIO_1WgzSamgvkXnJsmlc1efhwz24mY37XWk May 19 21:47:34.160012 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Domain-Id: None May 19 21:47:34.160012 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Domain-Name: None May 19 21:47:34.160012 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Identity-Status: Confirmed May 19 21:47:34.160012 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Is-Admin-Project: True May 19 21:47:34.160012 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Project-Domain-Id: default May 19 21:47:34.160012 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Project-Domain-Name: Default May 19 21:47:34.160012 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Project-Id: 9a4ad8679d5446b591d4083529f992cc May 19 21:47:34.160012 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Project-Name: tempest-AttachVolumeNegativeTest-1262812511 May 19 21:47:34.160012 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Role: reader,member May 19 21:47:34.160012 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Roles: reader,member May 19 21:47:34.161417 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/9a4ad8679d5446b591d4083529f992cc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/9a4ad8679d5446b591d4083529f992cc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_9a4ad8679d5446b591d4083529f992cc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/9a4ad8679d5446b591d4083529f992cc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}] May 19 21:47:34.161417 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Tenant: tempest-AttachVolumeNegativeTest-1262812511 May 19 21:47:34.161417 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Tenant-Id: 9a4ad8679d5446b591d4083529f992cc May 19 21:47:34.161417 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1262812511 May 19 21:47:34.161417 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-User: tempest-AttachVolumeNegativeTest-1262812511-project May 19 21:47:34.161417 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-User-Domain-Id: default May 19 21:47:34.161417 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-User-Domain-Name: Default May 19 21:47:34.161417 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-User-Id: b9bd7a1a0e804d23aaa68153549672c9 May 19 21:47:34.161417 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-User-Name: tempest-AttachVolumeNegativeTest-1262812511-project May 19 21:47:34.161417 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: method: > May 19 21:47:34.161417 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: exception: Instance b9d58902-c539-4c3e-8a00-b1aeb2cb9c52 could not be found. May 19 21:47:34.161417 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: action_args: {'id': 'b9d58902-c539-4c3e-8a00-b1aeb2cb9c52'} May 19 21:47:34.162201 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 21:47:34.162201 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:47:34.162201 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 21:47:34.162201 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 21:47:34.162201 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 21:47:34.162201 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 21:47:34.162201 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 21:47:34.162201 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 21:47:34.162201 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 21:47:34.162201 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 21:47:34.162201 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9d58902-c539-4c3e-8a00-b1aeb2cb9c52 could not be found. May 19 21:47:34.162201 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:47:34.162201 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 21:47:34.162201 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:47:34.162201 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:47:34.162201 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 21:47:34.162201 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 21:47:34.162201 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 21:47:34.162201 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 21:47:34.162201 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 21:47:34.163740 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 21:47:34.163740 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 21:47:34.163740 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 21:47:34.163740 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 21:47:34.163740 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 21:47:34.163740 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 21:47:34.163740 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 21:47:34.163740 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9d58902-c539-4c3e-8a00-b1aeb2cb9c52 could not be found. May 19 21:47:34.163740 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:47:34.163740 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 21:47:34.163740 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:47:34.163740 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:47:34.163740 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 21:47:34.163740 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 21:47:34.163740 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 21:47:34.163740 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 21:47:34.163740 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9d58902-c539-4c3e-8a00-b1aeb2cb9c52 could not be found. May 19 21:47:34.163740 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:47:34.164917 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-92a102df-b395-4854-b42a-ce76db9e1da6 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Returning 404 to user: Instance b9d58902-c539-4c3e-8a00-b1aeb2cb9c52 could not be found. {{(pid=124349) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 21:47:34.164917 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-92a102df-b395-4854-b42a-ce76db9e1da6 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] 10.222.0.65 "GET /compute/v2.1/servers/b9d58902-c539-4c3e-8a00-b1aeb2cb9c52" status: 404 len: 111 microversion: 2.1 time: 0.041514 May 19 21:47:34.164917 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 496/1002] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:47:34 2022] GET /compute/v2.1/servers/b9d58902-c539-4c3e-8a00-b1aeb2cb9c52 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 21:47:34.171615 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-f18826a3-bc12-40b4-b7ee-647d46f8d082 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Calling method '.version_select at 0x7fe36802c820>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:47:34.191631 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-f18826a3-bc12-40b4-b7ee-647d46f8d082 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1200629146" status: 202 len: 0 microversion: 2.1 time: 0.024666 May 19 21:47:34.192243 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 507/1003] 10.222.0.65 () {58 vars in 1220 bytes} [Thu May 19 21:47:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1200629146 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 21:47:34.895806 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-df4a77ee-83b8-4e6f-a3c4-ba72d8ab2049 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:47:34.896324 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-df4a77ee-83b8-4e6f-a3c4-ba72d8ab2049 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] [instance: 2d071024-fffe-422f-9730-0f429f40221b] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:47:34.902818 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-df4a77ee-83b8-4e6f-a3c4-ba72d8ab2049 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:47:34.903257 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-df4a77ee-83b8-4e6f-a3c4-ba72d8ab2049 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:47:34.904016 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-df4a77ee-83b8-4e6f-a3c4-ba72d8ab2049 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:47:34.904441 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-df4a77ee-83b8-4e6f-a3c4-ba72d8ab2049 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:47:34.987794 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.objects.instance [None req-df4a77ee-83b8-4e6f-a3c4-ba72d8ab2049 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lazy-loading 'services' on Instance uuid 2d071024-fffe-422f-9730-0f429f40221b {{(pid=124349) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 21:47:35.080722 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-df4a77ee-83b8-4e6f-a3c4-ba72d8ab2049 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] 10.222.0.65 "DELETE /compute/v2.1/servers/2d071024-fffe-422f-9730-0f429f40221b/os-volume_attachments/a03f9411-4a63-48f1-984b-c55e5ab165ee" status: 202 len: 0 microversion: 2.1 time: 0.188139 May 19 21:47:35.081550 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 497/1004] 10.222.0.65 () {58 vars in 1415 bytes} [Thu May 19 21:47:34 2022] DELETE /compute/v2.1/servers/2d071024-fffe-422f-9730-0f429f40221b/os-volume_attachments/a03f9411-4a63-48f1-984b-c55e5ab165ee => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 21:47:35.091654 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-5c0d0d1e-081a-477b-b479-e8d4e1861bc4 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:47:35.092713 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-5c0d0d1e-081a-477b-b479-e8d4e1861bc4 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] [instance: 2d071024-fffe-422f-9730-0f429f40221b] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:47:35.100196 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5c0d0d1e-081a-477b-b479-e8d4e1861bc4 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:47:35.100629 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5c0d0d1e-081a-477b-b479-e8d4e1861bc4 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:47:35.101642 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5c0d0d1e-081a-477b-b479-e8d4e1861bc4 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:47:35.102074 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5c0d0d1e-081a-477b-b479-e8d4e1861bc4 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:47:35.134397 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-5c0d0d1e-081a-477b-b479-e8d4e1861bc4 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] 10.222.0.65 "GET /compute/v2.1/servers/2d071024-fffe-422f-9730-0f429f40221b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046707 May 19 21:47:35.134973 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 508/1005] 10.222.0.65 () {58 vars in 1301 bytes} [Thu May 19 21:47:35 2022] GET /compute/v2.1/servers/2d071024-fffe-422f-9730-0f429f40221b/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 21:47:36.148238 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-0d4c60ac-49c1-4c32-8567-7309c215bba9 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:47:36.149280 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-0d4c60ac-49c1-4c32-8567-7309c215bba9 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] [instance: 2d071024-fffe-422f-9730-0f429f40221b] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:47:36.156332 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-0d4c60ac-49c1-4c32-8567-7309c215bba9 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:47:36.156767 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-0d4c60ac-49c1-4c32-8567-7309c215bba9 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:47:36.157558 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-0d4c60ac-49c1-4c32-8567-7309c215bba9 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:47:36.157992 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-0d4c60ac-49c1-4c32-8567-7309c215bba9 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:47:36.188091 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-0d4c60ac-49c1-4c32-8567-7309c215bba9 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] 10.222.0.65 "GET /compute/v2.1/servers/2d071024-fffe-422f-9730-0f429f40221b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044948 May 19 21:47:36.188651 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 498/1006] 10.222.0.65 () {58 vars in 1301 bytes} [Thu May 19 21:47:36 2022] GET /compute/v2.1/servers/2d071024-fffe-422f-9730-0f429f40221b/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 21:47:36.256783 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-7c524650-971a-4884-b110-d31b9500e1e7 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:47:36.257340 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-7c524650-971a-4884-b110-d31b9500e1e7 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] [instance: 2d071024-fffe-422f-9730-0f429f40221b] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:47:36.264410 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7c524650-971a-4884-b110-d31b9500e1e7 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:47:36.264857 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7c524650-971a-4884-b110-d31b9500e1e7 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:47:36.265609 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7c524650-971a-4884-b110-d31b9500e1e7 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:47:36.266035 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7c524650-971a-4884-b110-d31b9500e1e7 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:47:36.291231 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-7c524650-971a-4884-b110-d31b9500e1e7 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] [instance: 2d071024-fffe-422f-9730-0f429f40221b] Going to try to terminate instance {{(pid=124350) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 21:47:36.384339 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-7c524650-971a-4884-b110-d31b9500e1e7 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] 10.222.0.65 "DELETE /compute/v2.1/servers/2d071024-fffe-422f-9730-0f429f40221b" status: 204 len: 0 microversion: 2.1 time: 0.132859 May 19 21:47:36.385290 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 509/1007] 10.222.0.65 () {58 vars in 1238 bytes} [Thu May 19 21:47:36 2022] DELETE /compute/v2.1/servers/2d071024-fffe-422f-9730-0f429f40221b => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 21:47:36.399851 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-cca95543-f46e-49e0-bd64-d8441039ce50 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:47:36.400382 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-cca95543-f46e-49e0-bd64-d8441039ce50 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] [instance: 2d071024-fffe-422f-9730-0f429f40221b] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:47:36.407577 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-cca95543-f46e-49e0-bd64-d8441039ce50 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:47:36.408025 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-cca95543-f46e-49e0-bd64-d8441039ce50 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:47:36.408775 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-cca95543-f46e-49e0-bd64-d8441039ce50 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:47:36.409205 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-cca95543-f46e-49e0-bd64-d8441039ce50 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:47:36.546902 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-cca95543-f46e-49e0-bd64-d8441039ce50 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9bd7a1a0e804d23aaa68153549672c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4ad8679d5446b591d4083529f992cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:47:36.554704 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-cca95543-f46e-49e0-bd64-d8441039ce50 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] 10.222.0.65 "GET /compute/v2.1/servers/2d071024-fffe-422f-9730-0f429f40221b" status: 200 len: 1680 microversion: 2.1 time: 0.158981 May 19 21:47:36.555308 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 499/1008] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:47:36 2022] GET /compute/v2.1/servers/2d071024-fffe-422f-9730-0f429f40221b => generated 1680 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:47:37.573602 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-11aefe45-74c1-41cd-a365-c9fe1924027c tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:47:37.574223 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-11aefe45-74c1-41cd-a365-c9fe1924027c tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] [instance: 2d071024-fffe-422f-9730-0f429f40221b] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:47:37.581956 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-11aefe45-74c1-41cd-a365-c9fe1924027c tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:47:37.582500 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-11aefe45-74c1-41cd-a365-c9fe1924027c tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:47:37.583346 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-11aefe45-74c1-41cd-a365-c9fe1924027c tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:47:37.583868 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-11aefe45-74c1-41cd-a365-c9fe1924027c tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:47:37.735423 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-11aefe45-74c1-41cd-a365-c9fe1924027c tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9bd7a1a0e804d23aaa68153549672c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4ad8679d5446b591d4083529f992cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:47:37.744065 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-11aefe45-74c1-41cd-a365-c9fe1924027c tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] 10.222.0.65 "GET /compute/v2.1/servers/2d071024-fffe-422f-9730-0f429f40221b" status: 200 len: 1680 microversion: 2.1 time: 0.174704 May 19 21:47:37.744647 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 510/1009] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:47:37 2022] GET /compute/v2.1/servers/2d071024-fffe-422f-9730-0f429f40221b => generated 1680 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:47:38.761311 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-760f95de-f6df-4eae-88c5-4fccdec50bf0 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:47:38.762073 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-760f95de-f6df-4eae-88c5-4fccdec50bf0 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] [instance: 2d071024-fffe-422f-9730-0f429f40221b] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:47:38.769429 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-760f95de-f6df-4eae-88c5-4fccdec50bf0 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:47:38.769843 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-760f95de-f6df-4eae-88c5-4fccdec50bf0 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:47:38.770895 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-760f95de-f6df-4eae-88c5-4fccdec50bf0 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:47:38.771322 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-760f95de-f6df-4eae-88c5-4fccdec50bf0 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:47:38.861854 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-760f95de-f6df-4eae-88c5-4fccdec50bf0 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9bd7a1a0e804d23aaa68153549672c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4ad8679d5446b591d4083529f992cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:47:38.870836 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-760f95de-f6df-4eae-88c5-4fccdec50bf0 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] 10.222.0.65 "GET /compute/v2.1/servers/2d071024-fffe-422f-9730-0f429f40221b" status: 200 len: 1612 microversion: 2.1 time: 0.113582 May 19 21:47:38.871414 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 500/1010] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:47:38 2022] GET /compute/v2.1/servers/2d071024-fffe-422f-9730-0f429f40221b => generated 1612 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:47:39.156627 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [req-de45097e-3051-4389-9830-e97b5e3a9cad req-3cbdb3cf-3ee8-4b9f-8afd-b591c1d3b461 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d071024-fffe-422f-9730-0f429f40221b", "name": "network-vif-deleted", "tag": "2eae5b2b-b305-4be0-b92d-251bb9cc76ee"}]} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:47:39.176027 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-de45097e-3051-4389-9830-e97b5e3a9cad req-3cbdb3cf-3ee8-4b9f-8afd-b591c1d3b461 service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:47:39.176483 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-de45097e-3051-4389-9830-e97b5e3a9cad req-3cbdb3cf-3ee8-4b9f-8afd-b591c1d3b461 service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:47:39.188797 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.compute.server_external_events [req-de45097e-3051-4389-9830-e97b5e3a9cad req-3cbdb3cf-3ee8-4b9f-8afd-b591c1d3b461 service nova] Creating event network-vif-deleted:2eae5b2b-b305-4be0-b92d-251bb9cc76ee for instance 2d071024-fffe-422f-9730-0f429f40221b on hv-cinder-83563 May 19 21:47:39.198252 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [req-de45097e-3051-4389-9830-e97b5e3a9cad req-3cbdb3cf-3ee8-4b9f-8afd-b591c1d3b461 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046051 May 19 21:47:39.199198 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 511/1011] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 21:47:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 21:47:39.888634 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-7e469a0b-0225-4909-b823-c865cbc31e77 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:47:39.889247 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-7e469a0b-0225-4909-b823-c865cbc31e77 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] [instance: 2d071024-fffe-422f-9730-0f429f40221b] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:47:39.896192 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-7e469a0b-0225-4909-b823-c865cbc31e77 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:47:39.896634 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-7e469a0b-0225-4909-b823-c865cbc31e77 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:47:39.897401 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-7e469a0b-0225-4909-b823-c865cbc31e77 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:47:39.897833 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-7e469a0b-0225-4909-b823-c865cbc31e77 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:47:39.912608 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.wsgi [None req-7e469a0b-0225-4909-b823-c865cbc31e77 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] HTTP exception thrown: Instance 2d071024-fffe-422f-9730-0f429f40221b could not be found. May 19 21:47:39.915565 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-7e469a0b-0225-4909-b823-c865cbc31e77 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Request method failure captured: May 19 21:47:39.915565 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: request: GET /compute/v2.1/servers/2d071024-fffe-422f-9730-0f429f40221b HTTP/1.1 May 19 21:47:39.915565 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Accept: application/json May 19 21:47:39.915565 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Accept-Encoding: identity May 19 21:47:39.915565 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Connection: close May 19 21:47:39.915565 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Content-Length: 0 May 19 21:47:39.915565 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Content-Type: application/json May 19 21:47:39.915565 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Host: 10.222.0.65 May 19 21:47:39.915565 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Openstack-System-Scope: None May 19 21:47:39.915565 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: User-Agent: python-urllib3/1.26.9 May 19 21:47:39.915565 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Auth-Token: gAAAAABihro0hjkJU9dn5H_V0BsW6Kiuc0LK2zzds0zMxBbjGHXtL1t0ZqjSlGNcltxwXHoc07BXy5_tlLdRemOLc3ACSGx6_UHrVglb4Wh1urAO678uN1i0U1kqAvWHY9-SCVABYPa39QKPrM5KIO_1WgzSamgvkXnJsmlc1efhwz24mY37XWk May 19 21:47:39.915565 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Domain-Id: None May 19 21:47:39.915565 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Domain-Name: None May 19 21:47:39.915565 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Identity-Status: Confirmed May 19 21:47:39.915565 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Is-Admin-Project: True May 19 21:47:39.915565 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Project-Domain-Id: default May 19 21:47:39.915565 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Project-Domain-Name: Default May 19 21:47:39.915565 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Project-Id: 9a4ad8679d5446b591d4083529f992cc May 19 21:47:39.915565 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Project-Name: tempest-AttachVolumeNegativeTest-1262812511 May 19 21:47:39.915565 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Role: reader,member May 19 21:47:39.915565 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Roles: reader,member May 19 21:47:39.917011 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/9a4ad8679d5446b591d4083529f992cc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/9a4ad8679d5446b591d4083529f992cc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_9a4ad8679d5446b591d4083529f992cc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/9a4ad8679d5446b591d4083529f992cc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}] May 19 21:47:39.917011 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Tenant: tempest-AttachVolumeNegativeTest-1262812511 May 19 21:47:39.917011 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Tenant-Id: 9a4ad8679d5446b591d4083529f992cc May 19 21:47:39.917011 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1262812511 May 19 21:47:39.917011 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-User: tempest-AttachVolumeNegativeTest-1262812511-project May 19 21:47:39.917011 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-User-Domain-Id: default May 19 21:47:39.917011 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-User-Domain-Name: Default May 19 21:47:39.917011 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-User-Id: b9bd7a1a0e804d23aaa68153549672c9 May 19 21:47:39.917011 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-User-Name: tempest-AttachVolumeNegativeTest-1262812511-project May 19 21:47:39.917011 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: method: > May 19 21:47:39.917011 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: exception: Instance 2d071024-fffe-422f-9730-0f429f40221b could not be found. May 19 21:47:39.917011 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: action_args: {'id': '2d071024-fffe-422f-9730-0f429f40221b'} May 19 21:47:39.918081 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 21:47:39.918081 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:47:39.918081 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 21:47:39.918081 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 21:47:39.918081 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 21:47:39.918081 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 21:47:39.918081 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 21:47:39.918081 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 21:47:39.918081 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 21:47:39.918081 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 21:47:39.918081 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d071024-fffe-422f-9730-0f429f40221b could not be found. May 19 21:47:39.918081 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:47:39.918081 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 21:47:39.918081 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:47:39.918081 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:47:39.918081 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 21:47:39.918081 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 21:47:39.918081 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 21:47:39.918081 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 21:47:39.918081 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 21:47:39.919364 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 21:47:39.919364 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 21:47:39.919364 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 21:47:39.919364 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 21:47:39.919364 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 21:47:39.919364 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 21:47:39.919364 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 21:47:39.919364 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d071024-fffe-422f-9730-0f429f40221b could not be found. May 19 21:47:39.919364 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:47:39.919364 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 21:47:39.919364 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:47:39.919364 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:47:39.919364 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 21:47:39.919364 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 21:47:39.919364 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 21:47:39.919364 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 21:47:39.919364 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d071024-fffe-422f-9730-0f429f40221b could not be found. May 19 21:47:39.919364 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:47:39.920939 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-7e469a0b-0225-4909-b823-c865cbc31e77 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Returning 404 to user: Instance 2d071024-fffe-422f-9730-0f429f40221b could not be found. {{(pid=124349) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 21:47:39.920939 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-7e469a0b-0225-4909-b823-c865cbc31e77 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] 10.222.0.65 "GET /compute/v2.1/servers/2d071024-fffe-422f-9730-0f429f40221b" status: 404 len: 111 microversion: 2.1 time: 0.033601 May 19 21:47:39.920939 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 501/1012] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:47:39 2022] GET /compute/v2.1/servers/2d071024-fffe-422f-9730-0f429f40221b => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 21:47:39.927012 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-2985b169-eff8-4296-8a42-ee2ac73846a8 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Calling method '.version_select at 0x7fe368037f70>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:47:39.946793 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-2985b169-eff8-4296-8a42-ee2ac73846a8 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1862480501" status: 202 len: 0 microversion: 2.1 time: 0.023685 May 19 21:47:39.947077 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 512/1013] 10.222.0.65 () {58 vars in 1220 bytes} [Thu May 19 21:47:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1862480501 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 21:47:40.625981 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-575db35c-3366-4df7-b914-2f6c33a658e2 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Action: 'create', calling method: .version_select at 0x7fe3636df940>, body: {"keypair": {"name": "tempest-keypair-1785503022", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPVeKzH4rfATvRDQj3FpFN10RapRZhWpgOPynCJ6LtNS+dHWbY4rBewpI0KXRm/MdOb7cjQPBIp6OpH57An2uyWK9R0M5FgMJn4uMfTwvb7Hm30T42Vyrpg3f8hG7cWAsw=="}} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:47:40.640283 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.quota [None req-575db35c-3366-4df7-b914-2f6c33a658e2 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Getting quotas for project 9a4ad8679d5446b591d4083529f992cc. Resources: {'key_pairs'} {{(pid=124349) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 21:47:40.644301 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.quota [None req-575db35c-3366-4df7-b914-2f6c33a658e2 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Getting quotas for user b9bd7a1a0e804d23aaa68153549672c9 and project 9a4ad8679d5446b591d4083529f992cc. Resources: {'key_pairs'} {{(pid=124349) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 21:47:40.669343 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-575db35c-3366-4df7-b914-2f6c33a658e2 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.047510 May 19 21:47:40.669934 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 502/1014] 10.222.0.65 () {60 vars in 1158 bytes} [Thu May 19 21:47:40 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 21:47:41.973929 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-57600e40-8668-4242-89b7-cd61ecd0bcad tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-500770041", "imageRef": "a874457a-f8a8-46f6-bdcc-1fa632a0d3c0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c2dc31bc-9d9f-4b3a-a6c3-4de0dc53e03d"}], "security_groups": [{"name": "tempest-securitygroup--721058126"}], "key_name": "tempest-keypair-1785503022", "user_data": "}} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:47:42.081970 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.network.neutron [None req-57600e40-8668-4242-89b7-cd61ecd0bcad tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] validate_networks() for [('c2dc31bc-9d9f-4b3a-a6c3-4de0dc53e03d', None, None, None, None, None)] {{(pid=124350) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 19 21:47:42.542761 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.virt.hardware [None req-57600e40-8668-4242-89b7-cd61ecd0bcad tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Flavor limits 0:0:0 {{(pid=124350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 21:47:42.543180 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.virt.hardware [None req-57600e40-8668-4242-89b7-cd61ecd0bcad tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Image limits 0:0:0 {{(pid=124350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 21:47:42.543631 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.virt.hardware [None req-57600e40-8668-4242-89b7-cd61ecd0bcad tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Flavor pref 0:0:0 {{(pid=124350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 21:47:42.544074 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.virt.hardware [None req-57600e40-8668-4242-89b7-cd61ecd0bcad tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Image pref 0:0:0 {{(pid=124350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 21:47:42.544454 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.virt.hardware [None req-57600e40-8668-4242-89b7-cd61ecd0bcad tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 21:47:42.554152 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-57600e40-8668-4242-89b7-cd61ecd0bcad tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:47:42.554622 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-57600e40-8668-4242-89b7-cd61ecd0bcad tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:47:42.555421 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-57600e40-8668-4242-89b7-cd61ecd0bcad tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:47:42.556136 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-57600e40-8668-4242-89b7-cd61ecd0bcad tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:47:42.584512 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.quota [None req-57600e40-8668-4242-89b7-cd61ecd0bcad tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Getting quotas for project 9a4ad8679d5446b591d4083529f992cc. Resources: {'ram', 'cores', 'instances'} {{(pid=124350) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 21:47:42.589935 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.quota [None req-57600e40-8668-4242-89b7-cd61ecd0bcad tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Getting quotas for user b9bd7a1a0e804d23aaa68153549672c9 and project 9a4ad8679d5446b591d4083529f992cc. Resources: {'ram', 'cores', 'instances'} {{(pid=124350) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 21:47:42.606706 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-57600e40-8668-4242-89b7-cd61ecd0bcad tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Going to run 1 instances... {{(pid=124350) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 21:47:42.609095 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-57600e40-8668-4242-89b7-cd61ecd0bcad tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] [instance: 3600a05e-7f64-4e6c-872c-7e0dcf9f34e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a874457a-f8a8-46f6-bdcc-1fa632a0d3c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124350) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 21:47:42.664370 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-57600e40-8668-4242-89b7-cd61ecd0bcad tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.695395 May 19 21:47:42.665019 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 513/1015] 10.222.0.65 () {60 vars in 1146 bytes} [Thu May 19 21:47:41 2022] POST /compute/v2.1/servers => generated 401 bytes in 697 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 21:47:42.676070 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-e11a7e65-fe2a-4d0a-b560-a2633574e7b2 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:47:42.676758 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-e11a7e65-fe2a-4d0a-b560-a2633574e7b2 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] [instance: 3600a05e-7f64-4e6c-872c-7e0dcf9f34e8] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:47:42.737150 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-e11a7e65-fe2a-4d0a-b560-a2633574e7b2 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9bd7a1a0e804d23aaa68153549672c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4ad8679d5446b591d4083529f992cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:47:42.744556 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-e11a7e65-fe2a-4d0a-b560-a2633574e7b2 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] 10.222.0.65 "GET /compute/v2.1/servers/3600a05e-7f64-4e6c-872c-7e0dcf9f34e8" status: 200 len: 1241 microversion: 2.1 time: 0.073012 May 19 21:47:42.745258 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 503/1016] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:47:42 2022] GET /compute/v2.1/servers/3600a05e-7f64-4e6c-872c-7e0dcf9f34e8 => generated 1241 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:47:43.761062 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-e09f5a99-8d18-41b1-bfc9-cf60eada6130 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:47:43.761684 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-e09f5a99-8d18-41b1-bfc9-cf60eada6130 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] [instance: 3600a05e-7f64-4e6c-872c-7e0dcf9f34e8] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:47:43.769401 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e09f5a99-8d18-41b1-bfc9-cf60eada6130 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:47:43.769865 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e09f5a99-8d18-41b1-bfc9-cf60eada6130 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:47:43.770661 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e09f5a99-8d18-41b1-bfc9-cf60eada6130 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:47:43.771094 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e09f5a99-8d18-41b1-bfc9-cf60eada6130 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:47:43.833698 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-e09f5a99-8d18-41b1-bfc9-cf60eada6130 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9bd7a1a0e804d23aaa68153549672c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4ad8679d5446b591d4083529f992cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:47:43.841571 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-e09f5a99-8d18-41b1-bfc9-cf60eada6130 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] 10.222.0.65 "GET /compute/v2.1/servers/3600a05e-7f64-4e6c-872c-7e0dcf9f34e8" status: 200 len: 1299 microversion: 2.1 time: 0.084510 May 19 21:47:43.842153 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 514/1017] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:47:43 2022] GET /compute/v2.1/servers/3600a05e-7f64-4e6c-872c-7e0dcf9f34e8 => generated 1299 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:47:44.859688 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-e9a6b9d9-003a-4783-9f41-453efb880be9 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:47:44.860344 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-e9a6b9d9-003a-4783-9f41-453efb880be9 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] [instance: 3600a05e-7f64-4e6c-872c-7e0dcf9f34e8] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:47:44.868514 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e9a6b9d9-003a-4783-9f41-453efb880be9 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:47:44.869068 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e9a6b9d9-003a-4783-9f41-453efb880be9 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:47:44.869873 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e9a6b9d9-003a-4783-9f41-453efb880be9 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:47:44.870507 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e9a6b9d9-003a-4783-9f41-453efb880be9 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:47:45.275159 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-e9a6b9d9-003a-4783-9f41-453efb880be9 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9bd7a1a0e804d23aaa68153549672c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4ad8679d5446b591d4083529f992cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:47:45.283513 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-e9a6b9d9-003a-4783-9f41-453efb880be9 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] 10.222.0.65 "GET /compute/v2.1/servers/3600a05e-7f64-4e6c-872c-7e0dcf9f34e8" status: 200 len: 1366 microversion: 2.1 time: 0.427584 May 19 21:47:45.284279 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 504/1018] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:47:44 2022] GET /compute/v2.1/servers/3600a05e-7f64-4e6c-872c-7e0dcf9f34e8 => generated 1366 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:47:45.423938 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [req-298b6e6a-6d43-41f9-8d13-bcaae0ade4a1 req-b749a02f-b24c-4a9f-8a36-9fac887fc6b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3600a05e-7f64-4e6c-872c-7e0dcf9f34e8", "tag": "53afa677-7344-4d25-8082-d6b13ade69e9"}]} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:47:45.447832 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-298b6e6a-6d43-41f9-8d13-bcaae0ade4a1 req-b749a02f-b24c-4a9f-8a36-9fac887fc6b0 service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:47:45.448276 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-298b6e6a-6d43-41f9-8d13-bcaae0ade4a1 req-b749a02f-b24c-4a9f-8a36-9fac887fc6b0 service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:47:45.462569 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.compute.server_external_events [req-298b6e6a-6d43-41f9-8d13-bcaae0ade4a1 req-b749a02f-b24c-4a9f-8a36-9fac887fc6b0 service nova] Creating event network-changed:53afa677-7344-4d25-8082-d6b13ade69e9 for instance 3600a05e-7f64-4e6c-872c-7e0dcf9f34e8 on hv-cinder-83563 May 19 21:47:45.468244 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [req-298b6e6a-6d43-41f9-8d13-bcaae0ade4a1 req-b749a02f-b24c-4a9f-8a36-9fac887fc6b0 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052247 May 19 21:47:45.468854 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 515/1019] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 21:47:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 21:47:46.303856 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-149dd547-a8f4-4093-80f3-35591e6e8e75 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:47:46.304636 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-149dd547-a8f4-4093-80f3-35591e6e8e75 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] [instance: 3600a05e-7f64-4e6c-872c-7e0dcf9f34e8] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:47:46.314437 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-149dd547-a8f4-4093-80f3-35591e6e8e75 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:47:46.315039 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-149dd547-a8f4-4093-80f3-35591e6e8e75 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:47:46.316055 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-149dd547-a8f4-4093-80f3-35591e6e8e75 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:47:46.316628 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-149dd547-a8f4-4093-80f3-35591e6e8e75 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:47:46.463646 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-149dd547-a8f4-4093-80f3-35591e6e8e75 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9bd7a1a0e804d23aaa68153549672c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4ad8679d5446b591d4083529f992cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:47:46.471708 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-149dd547-a8f4-4093-80f3-35591e6e8e75 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] 10.222.0.65 "GET /compute/v2.1/servers/3600a05e-7f64-4e6c-872c-7e0dcf9f34e8" status: 200 len: 1366 microversion: 2.1 time: 0.173689 May 19 21:47:46.472339 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 505/1020] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:47:46 2022] GET /compute/v2.1/servers/3600a05e-7f64-4e6c-872c-7e0dcf9f34e8 => generated 1366 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:47:47.490983 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-60ac14f2-7a2a-4e08-a99e-2e14b1a0ae9b tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:47:47.491584 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-60ac14f2-7a2a-4e08-a99e-2e14b1a0ae9b tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] [instance: 3600a05e-7f64-4e6c-872c-7e0dcf9f34e8] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:47:47.499309 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-60ac14f2-7a2a-4e08-a99e-2e14b1a0ae9b tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:47:47.499754 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-60ac14f2-7a2a-4e08-a99e-2e14b1a0ae9b tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:47:47.500511 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-60ac14f2-7a2a-4e08-a99e-2e14b1a0ae9b tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:47:47.500943 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-60ac14f2-7a2a-4e08-a99e-2e14b1a0ae9b tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:47:47.662684 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-60ac14f2-7a2a-4e08-a99e-2e14b1a0ae9b tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9bd7a1a0e804d23aaa68153549672c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4ad8679d5446b591d4083529f992cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:47:47.674391 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-60ac14f2-7a2a-4e08-a99e-2e14b1a0ae9b tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] 10.222.0.65 "GET /compute/v2.1/servers/3600a05e-7f64-4e6c-872c-7e0dcf9f34e8" status: 200 len: 1366 microversion: 2.1 time: 0.188013 May 19 21:47:47.675091 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 516/1021] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:47:47 2022] GET /compute/v2.1/servers/3600a05e-7f64-4e6c-872c-7e0dcf9f34e8 => generated 1366 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:47:48.697123 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-834ec5bc-7c9d-450b-8a7b-c45f2384ebdf tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:47:48.697800 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-834ec5bc-7c9d-450b-8a7b-c45f2384ebdf tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] [instance: 3600a05e-7f64-4e6c-872c-7e0dcf9f34e8] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:47:48.705090 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-834ec5bc-7c9d-450b-8a7b-c45f2384ebdf tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:47:48.705544 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-834ec5bc-7c9d-450b-8a7b-c45f2384ebdf tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:47:48.706367 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-834ec5bc-7c9d-450b-8a7b-c45f2384ebdf tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:47:48.706778 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-834ec5bc-7c9d-450b-8a7b-c45f2384ebdf tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:47:48.853729 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-834ec5bc-7c9d-450b-8a7b-c45f2384ebdf tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9bd7a1a0e804d23aaa68153549672c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4ad8679d5446b591d4083529f992cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:47:48.862133 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-834ec5bc-7c9d-450b-8a7b-c45f2384ebdf tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] 10.222.0.65 "GET /compute/v2.1/servers/3600a05e-7f64-4e6c-872c-7e0dcf9f34e8" status: 200 len: 1366 microversion: 2.1 time: 0.170242 May 19 21:47:48.862834 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 506/1022] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:47:48 2022] GET /compute/v2.1/servers/3600a05e-7f64-4e6c-872c-7e0dcf9f34e8 => generated 1366 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:47:49.882543 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-264c49e6-6e9c-4cd0-9e36-88e82112d57a tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:47:49.883541 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-264c49e6-6e9c-4cd0-9e36-88e82112d57a tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] [instance: 3600a05e-7f64-4e6c-872c-7e0dcf9f34e8] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:47:49.893201 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-264c49e6-6e9c-4cd0-9e36-88e82112d57a tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:47:49.893874 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-264c49e6-6e9c-4cd0-9e36-88e82112d57a tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:47:49.895064 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-264c49e6-6e9c-4cd0-9e36-88e82112d57a tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:47:49.895736 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-264c49e6-6e9c-4cd0-9e36-88e82112d57a tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:47:50.036664 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-264c49e6-6e9c-4cd0-9e36-88e82112d57a tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9bd7a1a0e804d23aaa68153549672c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4ad8679d5446b591d4083529f992cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:47:50.047910 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-264c49e6-6e9c-4cd0-9e36-88e82112d57a tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] 10.222.0.65 "GET /compute/v2.1/servers/3600a05e-7f64-4e6c-872c-7e0dcf9f34e8" status: 200 len: 1366 microversion: 2.1 time: 0.171199 May 19 21:47:50.048892 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 517/1023] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:47:49 2022] GET /compute/v2.1/servers/3600a05e-7f64-4e6c-872c-7e0dcf9f34e8 => generated 1366 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:47:51.070683 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-40ac0dfb-f720-4d21-84cc-50c6e0fdd062 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:47:51.071285 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-40ac0dfb-f720-4d21-84cc-50c6e0fdd062 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] [instance: 3600a05e-7f64-4e6c-872c-7e0dcf9f34e8] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:47:51.079064 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-40ac0dfb-f720-4d21-84cc-50c6e0fdd062 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:47:51.079510 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-40ac0dfb-f720-4d21-84cc-50c6e0fdd062 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:47:51.080284 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-40ac0dfb-f720-4d21-84cc-50c6e0fdd062 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:47:51.080715 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-40ac0dfb-f720-4d21-84cc-50c6e0fdd062 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:47:51.228290 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-40ac0dfb-f720-4d21-84cc-50c6e0fdd062 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9bd7a1a0e804d23aaa68153549672c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4ad8679d5446b591d4083529f992cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:47:51.236206 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-40ac0dfb-f720-4d21-84cc-50c6e0fdd062 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] 10.222.0.65 "GET /compute/v2.1/servers/3600a05e-7f64-4e6c-872c-7e0dcf9f34e8" status: 200 len: 1366 microversion: 2.1 time: 0.169537 May 19 21:47:51.236782 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 507/1024] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:47:51 2022] GET /compute/v2.1/servers/3600a05e-7f64-4e6c-872c-7e0dcf9f34e8 => generated 1366 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:47:51.729443 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [req-987dd05f-5592-413d-b095-67de4116e865 req-bc116fb4-d9ee-4479-8b8d-f32c5b1ee4ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3600a05e-7f64-4e6c-872c-7e0dcf9f34e8", "name": "network-vif-plugged", "status": "completed", "tag": "53afa677-7344-4d25-8082-d6b13ade69e9"}]} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:47:51.738599 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-987dd05f-5592-413d-b095-67de4116e865 req-bc116fb4-d9ee-4479-8b8d-f32c5b1ee4ff service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:47:51.740345 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-987dd05f-5592-413d-b095-67de4116e865 req-bc116fb4-d9ee-4479-8b8d-f32c5b1ee4ff service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:47:51.752446 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.compute.server_external_events [req-987dd05f-5592-413d-b095-67de4116e865 req-bc116fb4-d9ee-4479-8b8d-f32c5b1ee4ff service nova] Creating event network-vif-plugged:53afa677-7344-4d25-8082-d6b13ade69e9 for instance 3600a05e-7f64-4e6c-872c-7e0dcf9f34e8 on hv-cinder-83563 May 19 21:47:51.757518 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [req-987dd05f-5592-413d-b095-67de4116e865 req-bc116fb4-d9ee-4479-8b8d-f32c5b1ee4ff service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031986 May 19 21:47:51.758091 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 518/1025] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 21:47:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 21:47:52.253701 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-4febfb8e-6380-422b-ad60-621947e8ec23 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:47:52.254358 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-4febfb8e-6380-422b-ad60-621947e8ec23 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] [instance: 3600a05e-7f64-4e6c-872c-7e0dcf9f34e8] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:47:52.261868 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-4febfb8e-6380-422b-ad60-621947e8ec23 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:47:52.262356 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-4febfb8e-6380-422b-ad60-621947e8ec23 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:47:52.263241 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-4febfb8e-6380-422b-ad60-621947e8ec23 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:47:52.263648 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-4febfb8e-6380-422b-ad60-621947e8ec23 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:47:52.409425 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-4febfb8e-6380-422b-ad60-621947e8ec23 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9bd7a1a0e804d23aaa68153549672c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4ad8679d5446b591d4083529f992cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:47:52.417139 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-4febfb8e-6380-422b-ad60-621947e8ec23 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] 10.222.0.65 "GET /compute/v2.1/servers/3600a05e-7f64-4e6c-872c-7e0dcf9f34e8" status: 200 len: 1366 microversion: 2.1 time: 0.167531 May 19 21:47:52.417717 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 508/1026] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:47:52 2022] GET /compute/v2.1/servers/3600a05e-7f64-4e6c-872c-7e0dcf9f34e8 => generated 1366 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:47:53.434287 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell0:SELECT=2 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:47:53.435298 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell0:SELECT=6 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:47:53.441218 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-443765e1-6b19-4237-a11d-ab40ad06ecf2 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:47:53.441916 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-443765e1-6b19-4237-a11d-ab40ad06ecf2 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] [instance: 3600a05e-7f64-4e6c-872c-7e0dcf9f34e8] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:47:53.449398 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-443765e1-6b19-4237-a11d-ab40ad06ecf2 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:47:53.449849 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-443765e1-6b19-4237-a11d-ab40ad06ecf2 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:47:53.450649 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-443765e1-6b19-4237-a11d-ab40ad06ecf2 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:47:53.451076 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-443765e1-6b19-4237-a11d-ab40ad06ecf2 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:47:53.604728 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-443765e1-6b19-4237-a11d-ab40ad06ecf2 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9bd7a1a0e804d23aaa68153549672c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4ad8679d5446b591d4083529f992cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:47:53.612509 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-443765e1-6b19-4237-a11d-ab40ad06ecf2 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] 10.222.0.65 "GET /compute/v2.1/servers/3600a05e-7f64-4e6c-872c-7e0dcf9f34e8" status: 200 len: 1366 microversion: 2.1 time: 0.179684 May 19 21:47:53.613462 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 519/1027] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:47:53 2022] GET /compute/v2.1/servers/3600a05e-7f64-4e6c-872c-7e0dcf9f34e8 => generated 1366 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:47:54.631269 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-180a74de-8564-4d6b-985f-08b3dd77905b tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:47:54.632011 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-180a74de-8564-4d6b-985f-08b3dd77905b tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] [instance: 3600a05e-7f64-4e6c-872c-7e0dcf9f34e8] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:47:54.634410 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_cell0:SELECT=6 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:47:54.643744 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-180a74de-8564-4d6b-985f-08b3dd77905b tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:47:54.644358 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-180a74de-8564-4d6b-985f-08b3dd77905b tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:47:54.645467 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-180a74de-8564-4d6b-985f-08b3dd77905b tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:47:54.645979 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-180a74de-8564-4d6b-985f-08b3dd77905b tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:47:54.808791 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-180a74de-8564-4d6b-985f-08b3dd77905b tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9bd7a1a0e804d23aaa68153549672c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4ad8679d5446b591d4083529f992cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:47:54.817365 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-180a74de-8564-4d6b-985f-08b3dd77905b tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] 10.222.0.65 "GET /compute/v2.1/servers/3600a05e-7f64-4e6c-872c-7e0dcf9f34e8" status: 200 len: 1556 microversion: 2.1 time: 0.191224 May 19 21:47:54.817947 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 509/1028] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:47:54 2022] GET /compute/v2.1/servers/3600a05e-7f64-4e6c-872c-7e0dcf9f34e8 => generated 1556 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:47:54.834730 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-ac2707f6-4912-4549-89d1-62696fd2cd13 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:47:54.835528 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-ac2707f6-4912-4549-89d1-62696fd2cd13 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] [instance: 3600a05e-7f64-4e6c-872c-7e0dcf9f34e8] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:47:54.844348 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ac2707f6-4912-4549-89d1-62696fd2cd13 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:47:54.844971 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ac2707f6-4912-4549-89d1-62696fd2cd13 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:47:54.845723 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ac2707f6-4912-4549-89d1-62696fd2cd13 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:47:54.846168 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-ac2707f6-4912-4549-89d1-62696fd2cd13 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:47:54.931687 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-ac2707f6-4912-4549-89d1-62696fd2cd13 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] 10.222.0.65 "GET /compute/v2.1/servers/3600a05e-7f64-4e6c-872c-7e0dcf9f34e8/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.101008 May 19 21:47:54.932254 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 520/1029] 10.222.0.65 () {58 vars in 1274 bytes} [Thu May 19 21:47:54 2022] GET /compute/v2.1/servers/3600a05e-7f64-4e6c-872c-7e0dcf9f34e8/os-interface => generated 285 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 21:47:56.200438 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [req-8343c73a-615c-41a9-ab93-3426473982b1 req-a13adb25-5638-4e69-b2cb-d9a91b821e8e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3600a05e-7f64-4e6c-872c-7e0dcf9f34e8", "tag": "53afa677-7344-4d25-8082-d6b13ade69e9"}]} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:47:56.209500 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-8343c73a-615c-41a9-ab93-3426473982b1 req-a13adb25-5638-4e69-b2cb-d9a91b821e8e service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:47:56.209947 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-8343c73a-615c-41a9-ab93-3426473982b1 req-a13adb25-5638-4e69-b2cb-d9a91b821e8e service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:47:56.221676 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.compute.server_external_events [req-8343c73a-615c-41a9-ab93-3426473982b1 req-a13adb25-5638-4e69-b2cb-d9a91b821e8e service nova] Creating event network-changed:53afa677-7344-4d25-8082-d6b13ade69e9 for instance 3600a05e-7f64-4e6c-872c-7e0dcf9f34e8 on hv-cinder-83563 May 19 21:47:56.227875 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [req-8343c73a-615c-41a9-ab93-3426473982b1 req-a13adb25-5638-4e69-b2cb-d9a91b821e8e service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031126 May 19 21:47:56.228712 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 510/1030] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 21:47:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 21:49:03.628054 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 21:49:03.628828 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Thu May 19 21:49:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 19 21:49:08.905450 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:49:08.906268 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:49:08.910484 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-1c300b7b-62e0-4016-a877-5a9334a09218 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:49:08.910991 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-1c300b7b-62e0-4016-a877-5a9334a09218 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] [instance: 3600a05e-7f64-4e6c-872c-7e0dcf9f34e8] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:49:08.918791 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1c300b7b-62e0-4016-a877-5a9334a09218 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:49:08.919210 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1c300b7b-62e0-4016-a877-5a9334a09218 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:49:08.919961 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1c300b7b-62e0-4016-a877-5a9334a09218 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:49:08.920381 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1c300b7b-62e0-4016-a877-5a9334a09218 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:49:08.946399 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-1c300b7b-62e0-4016-a877-5a9334a09218 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] 10.222.0.65 "GET /compute/v2.1/servers/3600a05e-7f64-4e6c-872c-7e0dcf9f34e8/ips" status: 200 len: 149 microversion: 2.1 time: 0.042970 May 19 21:49:08.946971 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 521/1031] 10.222.0.65 () {58 vars in 1247 bytes} [Thu May 19 21:49:08 2022] GET /compute/v2.1/servers/3600a05e-7f64-4e6c-872c-7e0dcf9f34e8/ips => generated 149 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 21:49:10.306841 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=1 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:49:10.307617 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=1 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:49:10.313005 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-e70af211-45c1-405f-b36f-69647ea6a297 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cb683773-d3cf-472e-9f0f-eefd2a702332"}} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:49:10.314163 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-e70af211-45c1-405f-b36f-69647ea6a297 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] [instance: 3600a05e-7f64-4e6c-872c-7e0dcf9f34e8] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:49:10.322821 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e70af211-45c1-405f-b36f-69647ea6a297 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:49:10.323270 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e70af211-45c1-405f-b36f-69647ea6a297 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:49:10.324020 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e70af211-45c1-405f-b36f-69647ea6a297 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:49:10.324448 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e70af211-45c1-405f-b36f-69647ea6a297 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:49:10.594655 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-e70af211-45c1-405f-b36f-69647ea6a297 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] 10.222.0.65 "POST /compute/v2.1/servers/3600a05e-7f64-4e6c-872c-7e0dcf9f34e8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.289757 May 19 21:49:10.595267 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 511/1032] 10.222.0.65 () {60 vars in 1322 bytes} [Thu May 19 21:49:10 2022] POST /compute/v2.1/servers/3600a05e-7f64-4e6c-872c-7e0dcf9f34e8/os-volume_attachments => generated 194 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 21:49:18.161456 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-9561d181-c086-45cf-8ac6-ce0dadf64a04 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cb683773-d3cf-472e-9f0f-eefd2a702332"}} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:49:18.162558 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-9561d181-c086-45cf-8ac6-ce0dadf64a04 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] [instance: 3600a05e-7f64-4e6c-872c-7e0dcf9f34e8] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:49:18.169699 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9561d181-c086-45cf-8ac6-ce0dadf64a04 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:49:18.170147 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9561d181-c086-45cf-8ac6-ce0dadf64a04 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:49:18.170943 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9561d181-c086-45cf-8ac6-ce0dadf64a04 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:49:18.171384 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-9561d181-c086-45cf-8ac6-ce0dadf64a04 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:49:18.260002 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.wsgi [None req-9561d181-c086-45cf-8ac6-ce0dadf64a04 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] HTTP exception thrown: Invalid volume: volume cb683773-d3cf-472e-9f0f-eefd2a702332 is already attached to instances: 3600a05e-7f64-4e6c-872c-7e0dcf9f34e8 May 19 21:49:18.261823 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-9561d181-c086-45cf-8ac6-ce0dadf64a04 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Request method failure captured: May 19 21:49:18.261823 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: request: POST /compute/v2.1/servers/3600a05e-7f64-4e6c-872c-7e0dcf9f34e8/os-volume_attachments HTTP/1.1 May 19 21:49:18.261823 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Accept: application/json May 19 21:49:18.261823 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Accept-Encoding: identity May 19 21:49:18.261823 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Connection: close May 19 21:49:18.261823 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Content-Length: 74 May 19 21:49:18.261823 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Content-Type: application/json May 19 21:49:18.261823 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Host: 10.222.0.65 May 19 21:49:18.261823 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Openstack-System-Scope: None May 19 21:49:18.261823 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: User-Agent: python-urllib3/1.26.9 May 19 21:49:18.261823 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Auth-Token: gAAAAABihro0hjkJU9dn5H_V0BsW6Kiuc0LK2zzds0zMxBbjGHXtL1t0ZqjSlGNcltxwXHoc07BXy5_tlLdRemOLc3ACSGx6_UHrVglb4Wh1urAO678uN1i0U1kqAvWHY9-SCVABYPa39QKPrM5KIO_1WgzSamgvkXnJsmlc1efhwz24mY37XWk May 19 21:49:18.261823 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Domain-Id: None May 19 21:49:18.261823 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Domain-Name: None May 19 21:49:18.261823 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Identity-Status: Confirmed May 19 21:49:18.261823 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Is-Admin-Project: True May 19 21:49:18.261823 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Project-Domain-Id: default May 19 21:49:18.261823 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Project-Domain-Name: Default May 19 21:49:18.261823 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Project-Id: 9a4ad8679d5446b591d4083529f992cc May 19 21:49:18.261823 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Project-Name: tempest-AttachVolumeNegativeTest-1262812511 May 19 21:49:18.261823 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Role: reader,member May 19 21:49:18.261823 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Roles: reader,member May 19 21:49:18.263879 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/9a4ad8679d5446b591d4083529f992cc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/9a4ad8679d5446b591d4083529f992cc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_9a4ad8679d5446b591d4083529f992cc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/9a4ad8679d5446b591d4083529f992cc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}] May 19 21:49:18.263879 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Tenant: tempest-AttachVolumeNegativeTest-1262812511 May 19 21:49:18.263879 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Tenant-Id: 9a4ad8679d5446b591d4083529f992cc May 19 21:49:18.263879 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1262812511 May 19 21:49:18.263879 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-User: tempest-AttachVolumeNegativeTest-1262812511-project May 19 21:49:18.263879 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-User-Domain-Id: default May 19 21:49:18.263879 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-User-Domain-Name: Default May 19 21:49:18.263879 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-User-Id: b9bd7a1a0e804d23aaa68153549672c9 May 19 21:49:18.263879 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-User-Name: tempest-AttachVolumeNegativeTest-1262812511-project May 19 21:49:18.263879 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: May 19 21:49:18.263879 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: {"volumeAttachment": {"volumeId": "cb683773-d3cf-472e-9f0f-eefd2a702332"}} May 19 21:49:18.263879 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: method: > May 19 21:49:18.264973 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: exception: Invalid volume: volume cb683773-d3cf-472e-9f0f-eefd2a702332 is already attached to instances: 3600a05e-7f64-4e6c-872c-7e0dcf9f34e8 May 19 21:49:18.264973 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: action_args: {'server_id': '3600a05e-7f64-4e6c-872c-7e0dcf9f34e8', 'body': {'volumeAttachment': {'volumeId': 'cb683773-d3cf-472e-9f0f-eefd2a702332'}}} May 19 21:49:18.264973 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 21:49:18.264973 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:49:18.264973 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 19 21:49:18.264973 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 19 21:49:18.264973 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 19 21:49:18.264973 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 19 21:49:18.264973 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 19 21:49:18.264973 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 19 21:49:18.264973 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 19 21:49:18.264973 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 19 21:49:18.264973 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 19 21:49:18.264973 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 19 21:49:18.264973 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume cb683773-d3cf-472e-9f0f-eefd2a702332 is already attached to instances: 3600a05e-7f64-4e6c-872c-7e0dcf9f34e8 May 19 21:49:18.264973 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi May 19 21:49:18.264973 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 21:49:18.264973 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi May 19 21:49:18.264973 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:49:18.266594 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 21:49:18.266594 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 21:49:18.266594 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 21:49:18.266594 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 21:49:18.266594 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 21:49:18.266594 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 21:49:18.266594 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 21:49:18.266594 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 21:49:18.266594 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 21:49:18.266594 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 21:49:18.266594 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 21:49:18.266594 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 21:49:18.266594 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 19 21:49:18.266594 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 19 21:49:18.266594 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume cb683773-d3cf-472e-9f0f-eefd2a702332 is already attached to instances: 3600a05e-7f64-4e6c-872c-7e0dcf9f34e8 May 19 21:49:18.266594 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi May 19 21:49:18.266594 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 21:49:18.266594 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi May 19 21:49:18.266594 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:49:18.266594 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 21:49:18.268148 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 21:49:18.268148 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 21:49:18.268148 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 21:49:18.268148 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume cb683773-d3cf-472e-9f0f-eefd2a702332 is already attached to instances: 3600a05e-7f64-4e6c-872c-7e0dcf9f34e8 May 19 21:49:18.268148 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi May 19 21:49:18.268148 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-9561d181-c086-45cf-8ac6-ce0dadf64a04 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Returning 400 to user: Invalid volume: volume cb683773-d3cf-472e-9f0f-eefd2a702332 is already attached to instances: 3600a05e-7f64-4e6c-872c-7e0dcf9f34e8 {{(pid=124350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 21:49:18.268148 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-9561d181-c086-45cf-8ac6-ce0dadf64a04 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] 10.222.0.65 "POST /compute/v2.1/servers/3600a05e-7f64-4e6c-872c-7e0dcf9f34e8/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.106076 May 19 21:49:18.268148 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 522/1033] 10.222.0.65 () {60 vars in 1322 bytes} [Thu May 19 21:49:18 2022] POST /compute/v2.1/servers/3600a05e-7f64-4e6c-872c-7e0dcf9f34e8/os-volume_attachments => generated 174 bytes in 108 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 19 21:49:18.329882 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-c2765cec-d060-4af5-adc2-cfd54e089ce0 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:49:18.330506 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-c2765cec-d060-4af5-adc2-cfd54e089ce0 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] [instance: 3600a05e-7f64-4e6c-872c-7e0dcf9f34e8] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:49:18.337615 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c2765cec-d060-4af5-adc2-cfd54e089ce0 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:49:18.338063 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c2765cec-d060-4af5-adc2-cfd54e089ce0 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:49:18.338868 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c2765cec-d060-4af5-adc2-cfd54e089ce0 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:49:18.339299 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-c2765cec-d060-4af5-adc2-cfd54e089ce0 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:49:18.425718 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.objects.instance [None req-c2765cec-d060-4af5-adc2-cfd54e089ce0 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lazy-loading 'services' on Instance uuid 3600a05e-7f64-4e6c-872c-7e0dcf9f34e8 {{(pid=124349) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 21:49:18.502422 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-c2765cec-d060-4af5-adc2-cfd54e089ce0 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] 10.222.0.65 "DELETE /compute/v2.1/servers/3600a05e-7f64-4e6c-872c-7e0dcf9f34e8/os-volume_attachments/cb683773-d3cf-472e-9f0f-eefd2a702332" status: 202 len: 0 microversion: 2.1 time: 0.176772 May 19 21:49:18.503016 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 512/1034] 10.222.0.65 () {58 vars in 1415 bytes} [Thu May 19 21:49:18 2022] DELETE /compute/v2.1/servers/3600a05e-7f64-4e6c-872c-7e0dcf9f34e8/os-volume_attachments/cb683773-d3cf-472e-9f0f-eefd2a702332 => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 21:49:18.515049 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-cc917fca-2e2c-4ac0-ad89-84516efd0cb1 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:49:18.516744 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-cc917fca-2e2c-4ac0-ad89-84516efd0cb1 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] [instance: 3600a05e-7f64-4e6c-872c-7e0dcf9f34e8] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:49:18.527390 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cc917fca-2e2c-4ac0-ad89-84516efd0cb1 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:49:18.527835 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cc917fca-2e2c-4ac0-ad89-84516efd0cb1 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:49:18.528603 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cc917fca-2e2c-4ac0-ad89-84516efd0cb1 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:49:18.529021 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cc917fca-2e2c-4ac0-ad89-84516efd0cb1 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:49:18.560401 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-cc917fca-2e2c-4ac0-ad89-84516efd0cb1 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] 10.222.0.65 "GET /compute/v2.1/servers/3600a05e-7f64-4e6c-872c-7e0dcf9f34e8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052617 May 19 21:49:18.560956 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 523/1035] 10.222.0.65 () {58 vars in 1301 bytes} [Thu May 19 21:49:18 2022] GET /compute/v2.1/servers/3600a05e-7f64-4e6c-872c-7e0dcf9f34e8/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 21:49:19.577382 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-30e7202a-01e6-4db5-a638-749fc3402349 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:49:19.578494 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-30e7202a-01e6-4db5-a638-749fc3402349 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] [instance: 3600a05e-7f64-4e6c-872c-7e0dcf9f34e8] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:49:19.585977 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-30e7202a-01e6-4db5-a638-749fc3402349 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:49:19.586482 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-30e7202a-01e6-4db5-a638-749fc3402349 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:49:19.587253 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-30e7202a-01e6-4db5-a638-749fc3402349 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:49:19.587691 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-30e7202a-01e6-4db5-a638-749fc3402349 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:49:19.618701 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-30e7202a-01e6-4db5-a638-749fc3402349 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] 10.222.0.65 "GET /compute/v2.1/servers/3600a05e-7f64-4e6c-872c-7e0dcf9f34e8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049016 May 19 21:49:19.619269 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 513/1036] 10.222.0.65 () {58 vars in 1301 bytes} [Thu May 19 21:49:19 2022] GET /compute/v2.1/servers/3600a05e-7f64-4e6c-872c-7e0dcf9f34e8/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 21:49:19.679149 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-3b96c386-0c21-4a01-ba29-084c066817ff tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:49:19.679705 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-3b96c386-0c21-4a01-ba29-084c066817ff tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] [instance: 3600a05e-7f64-4e6c-872c-7e0dcf9f34e8] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:49:19.686518 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3b96c386-0c21-4a01-ba29-084c066817ff tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:49:19.686959 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3b96c386-0c21-4a01-ba29-084c066817ff tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:49:19.687714 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3b96c386-0c21-4a01-ba29-084c066817ff tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:49:19.688140 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3b96c386-0c21-4a01-ba29-084c066817ff tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:49:19.714694 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-3b96c386-0c21-4a01-ba29-084c066817ff tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] [instance: 3600a05e-7f64-4e6c-872c-7e0dcf9f34e8] Going to try to terminate instance {{(pid=124350) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 21:49:19.803228 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-3b96c386-0c21-4a01-ba29-084c066817ff tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] 10.222.0.65 "DELETE /compute/v2.1/servers/3600a05e-7f64-4e6c-872c-7e0dcf9f34e8" status: 204 len: 0 microversion: 2.1 time: 0.127532 May 19 21:49:19.808947 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 524/1037] 10.222.0.65 () {58 vars in 1238 bytes} [Thu May 19 21:49:19 2022] DELETE /compute/v2.1/servers/3600a05e-7f64-4e6c-872c-7e0dcf9f34e8 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 21:49:19.813964 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-d6ac5e41-166d-4576-9255-f0d29bf553f6 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:49:19.814639 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-d6ac5e41-166d-4576-9255-f0d29bf553f6 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] [instance: 3600a05e-7f64-4e6c-872c-7e0dcf9f34e8] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:49:19.821985 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-d6ac5e41-166d-4576-9255-f0d29bf553f6 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:49:19.822460 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-d6ac5e41-166d-4576-9255-f0d29bf553f6 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:49:19.823215 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-d6ac5e41-166d-4576-9255-f0d29bf553f6 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:49:19.823643 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-d6ac5e41-166d-4576-9255-f0d29bf553f6 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:49:20.030684 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-d6ac5e41-166d-4576-9255-f0d29bf553f6 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9bd7a1a0e804d23aaa68153549672c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4ad8679d5446b591d4083529f992cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:49:20.039692 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-d6ac5e41-166d-4576-9255-f0d29bf553f6 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] 10.222.0.65 "GET /compute/v2.1/servers/3600a05e-7f64-4e6c-872c-7e0dcf9f34e8" status: 200 len: 1680 microversion: 2.1 time: 0.229632 May 19 21:49:20.040242 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 514/1038] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:49:19 2022] GET /compute/v2.1/servers/3600a05e-7f64-4e6c-872c-7e0dcf9f34e8 => generated 1680 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 21:49:21.064497 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-7c364b97-68cc-4ccc-a4ce-387d5865b187 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:49:21.065828 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-7c364b97-68cc-4ccc-a4ce-387d5865b187 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] [instance: 3600a05e-7f64-4e6c-872c-7e0dcf9f34e8] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:49:21.079277 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7c364b97-68cc-4ccc-a4ce-387d5865b187 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:49:21.080176 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7c364b97-68cc-4ccc-a4ce-387d5865b187 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:49:21.081793 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7c364b97-68cc-4ccc-a4ce-387d5865b187 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:49:21.082425 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7c364b97-68cc-4ccc-a4ce-387d5865b187 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:49:21.225947 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-7c364b97-68cc-4ccc-a4ce-387d5865b187 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9bd7a1a0e804d23aaa68153549672c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4ad8679d5446b591d4083529f992cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:49:21.233963 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-7c364b97-68cc-4ccc-a4ce-387d5865b187 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] 10.222.0.65 "GET /compute/v2.1/servers/3600a05e-7f64-4e6c-872c-7e0dcf9f34e8" status: 200 len: 1680 microversion: 2.1 time: 0.176004 May 19 21:49:21.234574 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 525/1039] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:49:21 2022] GET /compute/v2.1/servers/3600a05e-7f64-4e6c-872c-7e0dcf9f34e8 => generated 1680 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:49:22.253190 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-3c19dbb7-b943-4561-9652-c4a66c3d2378 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:49:22.253832 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-3c19dbb7-b943-4561-9652-c4a66c3d2378 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] [instance: 3600a05e-7f64-4e6c-872c-7e0dcf9f34e8] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:49:22.261422 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-3c19dbb7-b943-4561-9652-c4a66c3d2378 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:49:22.261872 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-3c19dbb7-b943-4561-9652-c4a66c3d2378 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:49:22.262688 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-3c19dbb7-b943-4561-9652-c4a66c3d2378 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:49:22.263127 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-3c19dbb7-b943-4561-9652-c4a66c3d2378 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:49:22.350358 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-3c19dbb7-b943-4561-9652-c4a66c3d2378 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9bd7a1a0e804d23aaa68153549672c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4ad8679d5446b591d4083529f992cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:49:22.359381 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-3c19dbb7-b943-4561-9652-c4a66c3d2378 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] 10.222.0.65 "GET /compute/v2.1/servers/3600a05e-7f64-4e6c-872c-7e0dcf9f34e8" status: 200 len: 1613 microversion: 2.1 time: 0.110495 May 19 21:49:22.359801 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 515/1040] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:49:22 2022] GET /compute/v2.1/servers/3600a05e-7f64-4e6c-872c-7e0dcf9f34e8 => generated 1613 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:49:22.465843 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [req-a3af8345-3df0-41f7-934b-88d3ff67cab3 req-acd3ac91-2051-45f0-aa93-ca3572516082 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3600a05e-7f64-4e6c-872c-7e0dcf9f34e8", "name": "network-vif-deleted", "tag": "53afa677-7344-4d25-8082-d6b13ade69e9"}]} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:49:22.476625 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-a3af8345-3df0-41f7-934b-88d3ff67cab3 req-acd3ac91-2051-45f0-aa93-ca3572516082 service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:49:22.477061 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-a3af8345-3df0-41f7-934b-88d3ff67cab3 req-acd3ac91-2051-45f0-aa93-ca3572516082 service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:49:22.489091 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.compute.server_external_events [req-a3af8345-3df0-41f7-934b-88d3ff67cab3 req-acd3ac91-2051-45f0-aa93-ca3572516082 service nova] Creating event network-vif-deleted:53afa677-7344-4d25-8082-d6b13ade69e9 for instance 3600a05e-7f64-4e6c-872c-7e0dcf9f34e8 on hv-cinder-83563 May 19 21:49:22.495915 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [req-a3af8345-3df0-41f7-934b-88d3ff67cab3 req-acd3ac91-2051-45f0-aa93-ca3572516082 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034718 May 19 21:49:22.496762 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 526/1041] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 21:49:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 21:49:23.376964 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-df7aef2d-f612-4c11-9058-96c9818e76c1 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:49:23.377690 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-df7aef2d-f612-4c11-9058-96c9818e76c1 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] [instance: 3600a05e-7f64-4e6c-872c-7e0dcf9f34e8] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:49:23.385360 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-df7aef2d-f612-4c11-9058-96c9818e76c1 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:49:23.385814 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-df7aef2d-f612-4c11-9058-96c9818e76c1 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:49:23.386595 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-df7aef2d-f612-4c11-9058-96c9818e76c1 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:49:23.387026 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-df7aef2d-f612-4c11-9058-96c9818e76c1 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:49:23.402306 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.wsgi [None req-df7aef2d-f612-4c11-9058-96c9818e76c1 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] HTTP exception thrown: Instance 3600a05e-7f64-4e6c-872c-7e0dcf9f34e8 could not be found. May 19 21:49:23.403930 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-df7aef2d-f612-4c11-9058-96c9818e76c1 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Request method failure captured: May 19 21:49:23.403930 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: request: GET /compute/v2.1/servers/3600a05e-7f64-4e6c-872c-7e0dcf9f34e8 HTTP/1.1 May 19 21:49:23.403930 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Accept: application/json May 19 21:49:23.403930 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Accept-Encoding: identity May 19 21:49:23.403930 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Connection: close May 19 21:49:23.403930 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Content-Length: 0 May 19 21:49:23.403930 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Content-Type: application/json May 19 21:49:23.403930 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Host: 10.222.0.65 May 19 21:49:23.403930 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Openstack-System-Scope: None May 19 21:49:23.403930 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: User-Agent: python-urllib3/1.26.9 May 19 21:49:23.403930 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Auth-Token: gAAAAABihro0hjkJU9dn5H_V0BsW6Kiuc0LK2zzds0zMxBbjGHXtL1t0ZqjSlGNcltxwXHoc07BXy5_tlLdRemOLc3ACSGx6_UHrVglb4Wh1urAO678uN1i0U1kqAvWHY9-SCVABYPa39QKPrM5KIO_1WgzSamgvkXnJsmlc1efhwz24mY37XWk May 19 21:49:23.403930 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Domain-Id: None May 19 21:49:23.403930 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Domain-Name: None May 19 21:49:23.403930 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Identity-Status: Confirmed May 19 21:49:23.403930 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Is-Admin-Project: True May 19 21:49:23.403930 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Project-Domain-Id: default May 19 21:49:23.403930 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Project-Domain-Name: Default May 19 21:49:23.403930 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Project-Id: 9a4ad8679d5446b591d4083529f992cc May 19 21:49:23.403930 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Project-Name: tempest-AttachVolumeNegativeTest-1262812511 May 19 21:49:23.403930 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Role: reader,member May 19 21:49:23.403930 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Roles: reader,member May 19 21:49:23.405263 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/9a4ad8679d5446b591d4083529f992cc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/9a4ad8679d5446b591d4083529f992cc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_9a4ad8679d5446b591d4083529f992cc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/9a4ad8679d5446b591d4083529f992cc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}] May 19 21:49:23.405263 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Tenant: tempest-AttachVolumeNegativeTest-1262812511 May 19 21:49:23.405263 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Tenant-Id: 9a4ad8679d5446b591d4083529f992cc May 19 21:49:23.405263 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1262812511 May 19 21:49:23.405263 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-User: tempest-AttachVolumeNegativeTest-1262812511-project May 19 21:49:23.405263 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-User-Domain-Id: default May 19 21:49:23.405263 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-User-Domain-Name: Default May 19 21:49:23.405263 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-User-Id: b9bd7a1a0e804d23aaa68153549672c9 May 19 21:49:23.405263 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-User-Name: tempest-AttachVolumeNegativeTest-1262812511-project May 19 21:49:23.405263 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: method: > May 19 21:49:23.405263 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: exception: Instance 3600a05e-7f64-4e6c-872c-7e0dcf9f34e8 could not be found. May 19 21:49:23.405263 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: action_args: {'id': '3600a05e-7f64-4e6c-872c-7e0dcf9f34e8'} May 19 21:49:23.406070 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 21:49:23.406070 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:49:23.406070 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 21:49:23.406070 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 21:49:23.406070 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 21:49:23.406070 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 21:49:23.406070 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 21:49:23.406070 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 21:49:23.406070 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 21:49:23.406070 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 21:49:23.406070 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3600a05e-7f64-4e6c-872c-7e0dcf9f34e8 could not be found. May 19 21:49:23.406070 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:49:23.406070 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 21:49:23.406070 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:49:23.406070 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:49:23.406070 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 21:49:23.406070 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 21:49:23.406070 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 21:49:23.406070 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 21:49:23.406070 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 21:49:23.407423 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 21:49:23.407423 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 21:49:23.407423 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 21:49:23.407423 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 21:49:23.407423 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 21:49:23.407423 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 21:49:23.407423 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 21:49:23.407423 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3600a05e-7f64-4e6c-872c-7e0dcf9f34e8 could not be found. May 19 21:49:23.407423 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:49:23.407423 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 21:49:23.407423 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:49:23.407423 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:49:23.407423 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 21:49:23.407423 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 21:49:23.407423 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 21:49:23.407423 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 21:49:23.407423 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3600a05e-7f64-4e6c-872c-7e0dcf9f34e8 could not be found. May 19 21:49:23.407423 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:49:23.408614 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-df7aef2d-f612-4c11-9058-96c9818e76c1 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Returning 404 to user: Instance 3600a05e-7f64-4e6c-872c-7e0dcf9f34e8 could not be found. {{(pid=124349) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 21:49:23.408614 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-df7aef2d-f612-4c11-9058-96c9818e76c1 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] 10.222.0.65 "GET /compute/v2.1/servers/3600a05e-7f64-4e6c-872c-7e0dcf9f34e8" status: 404 len: 111 microversion: 2.1 time: 0.032387 May 19 21:49:23.408614 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 516/1042] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:49:23 2022] GET /compute/v2.1/servers/3600a05e-7f64-4e6c-872c-7e0dcf9f34e8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 21:49:23.415602 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-814afb88-1c58-44b0-a3c5-6779a1244161 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Calling method '.version_select at 0x7fe363750af0>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:49:23.435021 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-814afb88-1c58-44b0-a3c5-6779a1244161 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1785503022" status: 202 len: 0 microversion: 2.1 time: 0.023548 May 19 21:49:23.435605 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 527/1043] 10.222.0.65 () {58 vars in 1220 bytes} [Thu May 19 21:49:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1785503022 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 21:49:24.101609 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-c6389d16-228f-4f7e-9261-f133f4dc8517 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Action: 'create', calling method: .version_select at 0x7fe36349a280>, body: {"keypair": {"name": "tempest-keypair-1618059623", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJptsdSsHG+KX0VWJ/9sZRbLbHv0fHIzcKilBHaR/hS01yN2C39hAdk3VsQ434vuxLvEDnh/T/Y8LAnu3wKa0uA+CGu0FPVaUTtDTlD6HQKYg8X7G/JG5RYEZeQJ+bQhCA=="}} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:49:24.117334 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.quota [None req-c6389d16-228f-4f7e-9261-f133f4dc8517 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Getting quotas for project 9a4ad8679d5446b591d4083529f992cc. Resources: {'key_pairs'} {{(pid=124349) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 21:49:24.121661 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.quota [None req-c6389d16-228f-4f7e-9261-f133f4dc8517 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Getting quotas for user b9bd7a1a0e804d23aaa68153549672c9 and project 9a4ad8679d5446b591d4083529f992cc. Resources: {'key_pairs'} {{(pid=124349) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 21:49:24.154635 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-c6389d16-228f-4f7e-9261-f133f4dc8517 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.056924 May 19 21:49:24.155372 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 517/1044] 10.222.0.65 () {60 vars in 1158 bytes} [Thu May 19 21:49:24 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 21:49:25.516392 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-d193e564-7833-49fe-a080-04fe67241457 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1005406962", "imageRef": "a874457a-f8a8-46f6-bdcc-1fa632a0d3c0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c2dc31bc-9d9f-4b3a-a6c3-4de0dc53e03d"}], "security_groups": [{"name": "tempest-securitygroup--1459229226"}], "key_name": "tempest-keypair-1618059623", "user_data": "}} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:49:25.627506 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.network.neutron [None req-d193e564-7833-49fe-a080-04fe67241457 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] validate_networks() for [('c2dc31bc-9d9f-4b3a-a6c3-4de0dc53e03d', None, None, None, None, None)] {{(pid=124350) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 19 21:49:26.017519 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.virt.hardware [None req-d193e564-7833-49fe-a080-04fe67241457 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Flavor limits 0:0:0 {{(pid=124350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 21:49:26.018194 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.virt.hardware [None req-d193e564-7833-49fe-a080-04fe67241457 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Image limits 0:0:0 {{(pid=124350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 21:49:26.018899 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.virt.hardware [None req-d193e564-7833-49fe-a080-04fe67241457 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Flavor pref 0:0:0 {{(pid=124350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 21:49:26.019454 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.virt.hardware [None req-d193e564-7833-49fe-a080-04fe67241457 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Image pref 0:0:0 {{(pid=124350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 21:49:26.020069 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.virt.hardware [None req-d193e564-7833-49fe-a080-04fe67241457 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 21:49:26.035446 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d193e564-7833-49fe-a080-04fe67241457 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:49:26.035888 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d193e564-7833-49fe-a080-04fe67241457 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:49:26.036645 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d193e564-7833-49fe-a080-04fe67241457 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:49:26.037307 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-d193e564-7833-49fe-a080-04fe67241457 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:49:26.054509 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.quota [None req-d193e564-7833-49fe-a080-04fe67241457 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Getting quotas for project 9a4ad8679d5446b591d4083529f992cc. Resources: {'ram', 'cores', 'instances'} {{(pid=124350) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 21:49:26.059179 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.quota [None req-d193e564-7833-49fe-a080-04fe67241457 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Getting quotas for user b9bd7a1a0e804d23aaa68153549672c9 and project 9a4ad8679d5446b591d4083529f992cc. Resources: {'ram', 'cores', 'instances'} {{(pid=124350) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 21:49:26.072500 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-d193e564-7833-49fe-a080-04fe67241457 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Going to run 1 instances... {{(pid=124350) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 21:49:26.074927 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-d193e564-7833-49fe-a080-04fe67241457 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] [instance: cb6423bc-f2f9-4346-b85e-1fa80b4e9b97] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a874457a-f8a8-46f6-bdcc-1fa632a0d3c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124350) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 21:49:26.124726 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-d193e564-7833-49fe-a080-04fe67241457 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.613215 May 19 21:49:26.125664 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 528/1045] 10.222.0.65 () {60 vars in 1146 bytes} [Thu May 19 21:49:25 2022] POST /compute/v2.1/servers => generated 402 bytes in 615 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 21:49:26.136242 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-03a7fb9f-fc0d-4d0b-a297-fc8c34375ae2 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:49:26.136878 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-03a7fb9f-fc0d-4d0b-a297-fc8c34375ae2 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] [instance: cb6423bc-f2f9-4346-b85e-1fa80b4e9b97] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:49:26.205584 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-03a7fb9f-fc0d-4d0b-a297-fc8c34375ae2 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9bd7a1a0e804d23aaa68153549672c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4ad8679d5446b591d4083529f992cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:49:26.214637 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-03a7fb9f-fc0d-4d0b-a297-fc8c34375ae2 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] 10.222.0.65 "GET /compute/v2.1/servers/cb6423bc-f2f9-4346-b85e-1fa80b4e9b97" status: 200 len: 1242 microversion: 2.1 time: 0.082843 May 19 21:49:26.215316 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 518/1046] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:49:26 2022] GET /compute/v2.1/servers/cb6423bc-f2f9-4346-b85e-1fa80b4e9b97 => generated 1242 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 21:49:27.232641 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-a1354134-ca3a-48ae-805a-50e050f5e7de tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:49:27.233298 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-a1354134-ca3a-48ae-805a-50e050f5e7de tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] [instance: cb6423bc-f2f9-4346-b85e-1fa80b4e9b97] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:49:27.242170 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a1354134-ca3a-48ae-805a-50e050f5e7de tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:49:27.242648 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a1354134-ca3a-48ae-805a-50e050f5e7de tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:49:27.243428 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a1354134-ca3a-48ae-805a-50e050f5e7de tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:49:27.244013 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a1354134-ca3a-48ae-805a-50e050f5e7de tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:49:27.333803 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-a1354134-ca3a-48ae-805a-50e050f5e7de tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9bd7a1a0e804d23aaa68153549672c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4ad8679d5446b591d4083529f992cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:49:27.341944 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-a1354134-ca3a-48ae-805a-50e050f5e7de tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] 10.222.0.65 "GET /compute/v2.1/servers/cb6423bc-f2f9-4346-b85e-1fa80b4e9b97" status: 200 len: 1312 microversion: 2.1 time: 0.113978 May 19 21:49:27.342527 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 529/1047] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:49:27 2022] GET /compute/v2.1/servers/cb6423bc-f2f9-4346-b85e-1fa80b4e9b97 => generated 1312 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:49:28.360341 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-2ebced3a-a574-4e41-a948-bf7d22aea456 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:49:28.361531 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-2ebced3a-a574-4e41-a948-bf7d22aea456 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] [instance: cb6423bc-f2f9-4346-b85e-1fa80b4e9b97] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:49:28.371389 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-2ebced3a-a574-4e41-a948-bf7d22aea456 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:49:28.371819 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-2ebced3a-a574-4e41-a948-bf7d22aea456 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:49:28.372610 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-2ebced3a-a574-4e41-a948-bf7d22aea456 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:49:28.373026 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-2ebced3a-a574-4e41-a948-bf7d22aea456 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:49:28.546305 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-2ebced3a-a574-4e41-a948-bf7d22aea456 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9bd7a1a0e804d23aaa68153549672c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4ad8679d5446b591d4083529f992cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:49:28.554356 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-2ebced3a-a574-4e41-a948-bf7d22aea456 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] 10.222.0.65 "GET /compute/v2.1/servers/cb6423bc-f2f9-4346-b85e-1fa80b4e9b97" status: 200 len: 1368 microversion: 2.1 time: 0.198479 May 19 21:49:28.554964 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 519/1048] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:49:28 2022] GET /compute/v2.1/servers/cb6423bc-f2f9-4346-b85e-1fa80b4e9b97 => generated 1368 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:49:28.938558 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [req-0233f128-eb65-449d-885f-661b3670f53b req-ca2efc93-6470-46f3-af81-fa72ca7dd1e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb6423bc-f2f9-4346-b85e-1fa80b4e9b97", "tag": "cb4f259d-fc85-4e6d-9f30-29b82cfcbd44"}]} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:49:28.953373 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-0233f128-eb65-449d-885f-661b3670f53b req-ca2efc93-6470-46f3-af81-fa72ca7dd1e7 service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:49:28.954647 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-0233f128-eb65-449d-885f-661b3670f53b req-ca2efc93-6470-46f3-af81-fa72ca7dd1e7 service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:49:28.969498 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.compute.server_external_events [req-0233f128-eb65-449d-885f-661b3670f53b req-ca2efc93-6470-46f3-af81-fa72ca7dd1e7 service nova] Creating event network-changed:cb4f259d-fc85-4e6d-9f30-29b82cfcbd44 for instance cb6423bc-f2f9-4346-b85e-1fa80b4e9b97 on hv-cinder-83563 May 19 21:49:28.974938 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [req-0233f128-eb65-449d-885f-661b3670f53b req-ca2efc93-6470-46f3-af81-fa72ca7dd1e7 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041534 May 19 21:49:28.975710 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 530/1049] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 21:49:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 21:49:29.572818 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-87b033c1-653a-4476-98b0-fddce5e77a5f tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:49:29.573395 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-87b033c1-653a-4476-98b0-fddce5e77a5f tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] [instance: cb6423bc-f2f9-4346-b85e-1fa80b4e9b97] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:49:29.580267 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-87b033c1-653a-4476-98b0-fddce5e77a5f tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:49:29.580708 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-87b033c1-653a-4476-98b0-fddce5e77a5f tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:49:29.581446 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-87b033c1-653a-4476-98b0-fddce5e77a5f tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:49:29.581931 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-87b033c1-653a-4476-98b0-fddce5e77a5f tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:49:29.733782 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-87b033c1-653a-4476-98b0-fddce5e77a5f tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9bd7a1a0e804d23aaa68153549672c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4ad8679d5446b591d4083529f992cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:49:29.746197 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-87b033c1-653a-4476-98b0-fddce5e77a5f tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] 10.222.0.65 "GET /compute/v2.1/servers/cb6423bc-f2f9-4346-b85e-1fa80b4e9b97" status: 200 len: 1368 microversion: 2.1 time: 0.177616 May 19 21:49:29.746986 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 520/1050] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:49:29 2022] GET /compute/v2.1/servers/cb6423bc-f2f9-4346-b85e-1fa80b4e9b97 => generated 1368 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:49:30.768100 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-17128752-185c-4293-a8b1-7cbfdef88f6c tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:49:30.768953 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-17128752-185c-4293-a8b1-7cbfdef88f6c tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] [instance: cb6423bc-f2f9-4346-b85e-1fa80b4e9b97] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:49:30.776100 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-17128752-185c-4293-a8b1-7cbfdef88f6c tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:49:30.776498 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-17128752-185c-4293-a8b1-7cbfdef88f6c tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:49:30.777276 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-17128752-185c-4293-a8b1-7cbfdef88f6c tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:49:30.777705 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-17128752-185c-4293-a8b1-7cbfdef88f6c tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:49:30.923781 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-17128752-185c-4293-a8b1-7cbfdef88f6c tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9bd7a1a0e804d23aaa68153549672c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4ad8679d5446b591d4083529f992cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:49:30.933273 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-17128752-185c-4293-a8b1-7cbfdef88f6c tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] 10.222.0.65 "GET /compute/v2.1/servers/cb6423bc-f2f9-4346-b85e-1fa80b4e9b97" status: 200 len: 1368 microversion: 2.1 time: 0.170050 May 19 21:49:30.933848 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 531/1051] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:49:30 2022] GET /compute/v2.1/servers/cb6423bc-f2f9-4346-b85e-1fa80b4e9b97 => generated 1368 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:49:31.950542 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-f869169a-056b-4958-8418-dd43b5373a27 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:49:31.951411 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-f869169a-056b-4958-8418-dd43b5373a27 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] [instance: cb6423bc-f2f9-4346-b85e-1fa80b4e9b97] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:49:31.958688 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f869169a-056b-4958-8418-dd43b5373a27 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:49:31.959139 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f869169a-056b-4958-8418-dd43b5373a27 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:49:31.960102 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f869169a-056b-4958-8418-dd43b5373a27 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:49:31.960543 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f869169a-056b-4958-8418-dd43b5373a27 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:49:32.150540 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-f869169a-056b-4958-8418-dd43b5373a27 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9bd7a1a0e804d23aaa68153549672c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4ad8679d5446b591d4083529f992cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:49:32.158341 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-f869169a-056b-4958-8418-dd43b5373a27 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] 10.222.0.65 "GET /compute/v2.1/servers/cb6423bc-f2f9-4346-b85e-1fa80b4e9b97" status: 200 len: 1368 microversion: 2.1 time: 0.212049 May 19 21:49:32.158857 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 521/1052] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:49:31 2022] GET /compute/v2.1/servers/cb6423bc-f2f9-4346-b85e-1fa80b4e9b97 => generated 1368 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:49:33.179957 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-86f47dff-34f1-42eb-967d-e75ec7232662 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:49:33.180524 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-86f47dff-34f1-42eb-967d-e75ec7232662 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] [instance: cb6423bc-f2f9-4346-b85e-1fa80b4e9b97] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:49:33.187688 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-86f47dff-34f1-42eb-967d-e75ec7232662 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:49:33.188141 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-86f47dff-34f1-42eb-967d-e75ec7232662 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:49:33.188909 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-86f47dff-34f1-42eb-967d-e75ec7232662 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:49:33.189352 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-86f47dff-34f1-42eb-967d-e75ec7232662 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:49:33.334668 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-86f47dff-34f1-42eb-967d-e75ec7232662 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9bd7a1a0e804d23aaa68153549672c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4ad8679d5446b591d4083529f992cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:49:33.343452 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-86f47dff-34f1-42eb-967d-e75ec7232662 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] 10.222.0.65 "GET /compute/v2.1/servers/cb6423bc-f2f9-4346-b85e-1fa80b4e9b97" status: 200 len: 1368 microversion: 2.1 time: 0.168605 May 19 21:49:33.344025 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 532/1053] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:49:33 2022] GET /compute/v2.1/servers/cb6423bc-f2f9-4346-b85e-1fa80b4e9b97 => generated 1368 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:49:34.363151 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-e3f43f58-688c-4b09-bead-2eb976e8f931 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:49:34.363766 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-e3f43f58-688c-4b09-bead-2eb976e8f931 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] [instance: cb6423bc-f2f9-4346-b85e-1fa80b4e9b97] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:49:34.371731 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e3f43f58-688c-4b09-bead-2eb976e8f931 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:49:34.372190 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e3f43f58-688c-4b09-bead-2eb976e8f931 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:49:34.373131 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e3f43f58-688c-4b09-bead-2eb976e8f931 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:49:34.373710 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e3f43f58-688c-4b09-bead-2eb976e8f931 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:49:34.383098 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [req-079be1b4-bbbd-4793-9fc5-a42d3eaf00e8 req-01f18100-aaf5-492d-8575-0cd1ef5e8c5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb6423bc-f2f9-4346-b85e-1fa80b4e9b97", "name": "network-vif-plugged", "status": "completed", "tag": "cb4f259d-fc85-4e6d-9f30-29b82cfcbd44"}]} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:49:34.391698 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-079be1b4-bbbd-4793-9fc5-a42d3eaf00e8 req-01f18100-aaf5-492d-8575-0cd1ef5e8c5a service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:49:34.392207 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-079be1b4-bbbd-4793-9fc5-a42d3eaf00e8 req-01f18100-aaf5-492d-8575-0cd1ef5e8c5a service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:49:34.403671 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.compute.server_external_events [req-079be1b4-bbbd-4793-9fc5-a42d3eaf00e8 req-01f18100-aaf5-492d-8575-0cd1ef5e8c5a service nova] Creating event network-vif-plugged:cb4f259d-fc85-4e6d-9f30-29b82cfcbd44 for instance cb6423bc-f2f9-4346-b85e-1fa80b4e9b97 on hv-cinder-83563 May 19 21:49:34.408859 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [req-079be1b4-bbbd-4793-9fc5-a42d3eaf00e8 req-01f18100-aaf5-492d-8575-0cd1ef5e8c5a service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099886 May 19 21:49:34.409544 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 522/1054] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 21:49:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 21:49:34.511662 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-e3f43f58-688c-4b09-bead-2eb976e8f931 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9bd7a1a0e804d23aaa68153549672c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4ad8679d5446b591d4083529f992cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:49:34.519887 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-e3f43f58-688c-4b09-bead-2eb976e8f931 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] 10.222.0.65 "GET /compute/v2.1/servers/cb6423bc-f2f9-4346-b85e-1fa80b4e9b97" status: 200 len: 1368 microversion: 2.1 time: 0.160881 May 19 21:49:34.520574 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 533/1055] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:49:34 2022] GET /compute/v2.1/servers/cb6423bc-f2f9-4346-b85e-1fa80b4e9b97 => generated 1368 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:49:35.538618 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-9044e43f-c633-4af1-bb38-979797fb34fe tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:49:35.539214 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-9044e43f-c633-4af1-bb38-979797fb34fe tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] [instance: cb6423bc-f2f9-4346-b85e-1fa80b4e9b97] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:49:35.546839 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-9044e43f-c633-4af1-bb38-979797fb34fe tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:49:35.547337 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-9044e43f-c633-4af1-bb38-979797fb34fe tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:49:35.548179 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-9044e43f-c633-4af1-bb38-979797fb34fe tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:49:35.548794 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-9044e43f-c633-4af1-bb38-979797fb34fe tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:49:35.703422 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-9044e43f-c633-4af1-bb38-979797fb34fe tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9bd7a1a0e804d23aaa68153549672c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4ad8679d5446b591d4083529f992cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:49:35.714523 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-9044e43f-c633-4af1-bb38-979797fb34fe tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] 10.222.0.65 "GET /compute/v2.1/servers/cb6423bc-f2f9-4346-b85e-1fa80b4e9b97" status: 200 len: 1368 microversion: 2.1 time: 0.180714 May 19 21:49:35.715339 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 523/1056] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:49:35 2022] GET /compute/v2.1/servers/cb6423bc-f2f9-4346-b85e-1fa80b4e9b97 => generated 1368 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:49:36.738225 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-1835bf60-f3da-4d6f-94e0-8f139646de19 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:49:36.738855 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-1835bf60-f3da-4d6f-94e0-8f139646de19 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] [instance: cb6423bc-f2f9-4346-b85e-1fa80b4e9b97] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:49:36.741710 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell0:SELECT=2 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:49:36.742464 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell0:SELECT=6 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:49:36.749304 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1835bf60-f3da-4d6f-94e0-8f139646de19 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:49:36.749684 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1835bf60-f3da-4d6f-94e0-8f139646de19 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:49:36.750487 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1835bf60-f3da-4d6f-94e0-8f139646de19 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:49:36.750911 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1835bf60-f3da-4d6f-94e0-8f139646de19 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:49:36.893459 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-1835bf60-f3da-4d6f-94e0-8f139646de19 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9bd7a1a0e804d23aaa68153549672c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4ad8679d5446b591d4083529f992cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:49:36.901551 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-1835bf60-f3da-4d6f-94e0-8f139646de19 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] 10.222.0.65 "GET /compute/v2.1/servers/cb6423bc-f2f9-4346-b85e-1fa80b4e9b97" status: 200 len: 1557 microversion: 2.1 time: 0.167484 May 19 21:49:36.902129 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 534/1057] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:49:36 2022] GET /compute/v2.1/servers/cb6423bc-f2f9-4346-b85e-1fa80b4e9b97 => generated 1557 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:49:36.921192 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-4814bd6b-2bd2-47bd-ad04-59b43feebe93 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:49:36.921924 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-4814bd6b-2bd2-47bd-ad04-59b43feebe93 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] [instance: cb6423bc-f2f9-4346-b85e-1fa80b4e9b97] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:49:36.924888 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_cell0:SELECT=6 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:49:36.933030 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-4814bd6b-2bd2-47bd-ad04-59b43feebe93 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:49:36.933481 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-4814bd6b-2bd2-47bd-ad04-59b43feebe93 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:49:36.934263 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-4814bd6b-2bd2-47bd-ad04-59b43feebe93 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:49:36.934708 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-4814bd6b-2bd2-47bd-ad04-59b43feebe93 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:49:37.030374 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-4814bd6b-2bd2-47bd-ad04-59b43feebe93 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] 10.222.0.65 "GET /compute/v2.1/servers/cb6423bc-f2f9-4346-b85e-1fa80b4e9b97/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.115390 May 19 21:49:37.031338 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 524/1058] 10.222.0.65 () {58 vars in 1274 bytes} [Thu May 19 21:49:36 2022] GET /compute/v2.1/servers/cb6423bc-f2f9-4346-b85e-1fa80b4e9b97/os-interface => generated 284 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 21:49:38.037510 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [req-9f77009f-98ca-4892-a099-f7e9bb680b60 req-d69fe69e-a383-43bf-8dad-da6aeefd6767 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb6423bc-f2f9-4346-b85e-1fa80b4e9b97", "tag": "cb4f259d-fc85-4e6d-9f30-29b82cfcbd44"}]} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:49:38.047247 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-9f77009f-98ca-4892-a099-f7e9bb680b60 req-d69fe69e-a383-43bf-8dad-da6aeefd6767 service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:49:38.047687 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-9f77009f-98ca-4892-a099-f7e9bb680b60 req-d69fe69e-a383-43bf-8dad-da6aeefd6767 service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:49:38.061865 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.compute.server_external_events [req-9f77009f-98ca-4892-a099-f7e9bb680b60 req-d69fe69e-a383-43bf-8dad-da6aeefd6767 service nova] Creating event network-changed:cb4f259d-fc85-4e6d-9f30-29b82cfcbd44 for instance cb6423bc-f2f9-4346-b85e-1fa80b4e9b97 on hv-cinder-83563 May 19 21:49:38.067183 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [req-9f77009f-98ca-4892-a099-f7e9bb680b60 req-d69fe69e-a383-43bf-8dad-da6aeefd6767 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033323 May 19 21:49:38.067775 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 535/1059] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 21:49:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 21:50:53.031177 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:50:53.031981 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:50:53.036642 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-7174dd68-6f95-41d0-9ef8-7404ae1aec87 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:50:53.037150 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-7174dd68-6f95-41d0-9ef8-7404ae1aec87 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] [instance: cb6423bc-f2f9-4346-b85e-1fa80b4e9b97] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:50:53.045441 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-7174dd68-6f95-41d0-9ef8-7404ae1aec87 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:50:53.045881 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-7174dd68-6f95-41d0-9ef8-7404ae1aec87 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:50:53.046683 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-7174dd68-6f95-41d0-9ef8-7404ae1aec87 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:50:53.047109 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-7174dd68-6f95-41d0-9ef8-7404ae1aec87 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:50:53.074154 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-7174dd68-6f95-41d0-9ef8-7404ae1aec87 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] 10.222.0.65 "GET /compute/v2.1/servers/cb6423bc-f2f9-4346-b85e-1fa80b4e9b97/ips" status: 200 len: 149 microversion: 2.1 time: 0.045026 May 19 21:50:53.074785 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 525/1060] 10.222.0.65 () {58 vars in 1247 bytes} [Thu May 19 21:50:53 2022] GET /compute/v2.1/servers/cb6423bc-f2f9-4346-b85e-1fa80b4e9b97/ips => generated 149 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 21:50:54.407233 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:50:54.407982 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:50:54.412654 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-f5f30fae-d910-4ccc-92e2-ee22dc735fd6 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f8514ee6-24f0-4876-b8a3-315440ee9e18"}} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:50:54.413791 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-f5f30fae-d910-4ccc-92e2-ee22dc735fd6 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] [instance: cb6423bc-f2f9-4346-b85e-1fa80b4e9b97] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:50:54.422554 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f5f30fae-d910-4ccc-92e2-ee22dc735fd6 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:50:54.422997 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f5f30fae-d910-4ccc-92e2-ee22dc735fd6 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:50:54.423753 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f5f30fae-d910-4ccc-92e2-ee22dc735fd6 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:50:54.424178 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f5f30fae-d910-4ccc-92e2-ee22dc735fd6 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:50:54.697529 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-f5f30fae-d910-4ccc-92e2-ee22dc735fd6 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] 10.222.0.65 "POST /compute/v2.1/servers/cb6423bc-f2f9-4346-b85e-1fa80b4e9b97/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.292294 May 19 21:50:54.698139 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 536/1061] 10.222.0.65 () {60 vars in 1322 bytes} [Thu May 19 21:50:54 2022] POST /compute/v2.1/servers/cb6423bc-f2f9-4346-b85e-1fa80b4e9b97/os-volume_attachments => generated 194 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 21:51:02.378948 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-5c142d5c-92b4-472c-b463-fd58a858171f tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:51:02.379527 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-5c142d5c-92b4-472c-b463-fd58a858171f tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] [instance: cb6423bc-f2f9-4346-b85e-1fa80b4e9b97] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:51:02.386174 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-5c142d5c-92b4-472c-b463-fd58a858171f tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:51:02.386658 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-5c142d5c-92b4-472c-b463-fd58a858171f tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:51:02.387414 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-5c142d5c-92b4-472c-b463-fd58a858171f tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:51:02.387842 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-5c142d5c-92b4-472c-b463-fd58a858171f tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:51:02.472519 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.objects.instance [None req-5c142d5c-92b4-472c-b463-fd58a858171f tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lazy-loading 'services' on Instance uuid cb6423bc-f2f9-4346-b85e-1fa80b4e9b97 {{(pid=124349) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 21:51:02.553250 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-5c142d5c-92b4-472c-b463-fd58a858171f tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] 10.222.0.65 "DELETE /compute/v2.1/servers/cb6423bc-f2f9-4346-b85e-1fa80b4e9b97/os-volume_attachments/f8514ee6-24f0-4876-b8a3-315440ee9e18" status: 202 len: 0 microversion: 2.1 time: 0.178713 May 19 21:51:02.553835 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 526/1062] 10.222.0.65 () {58 vars in 1415 bytes} [Thu May 19 21:51:02 2022] DELETE /compute/v2.1/servers/cb6423bc-f2f9-4346-b85e-1fa80b4e9b97/os-volume_attachments/f8514ee6-24f0-4876-b8a3-315440ee9e18 => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 21:51:02.563637 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-7475ee6a-72d4-4ab1-8a99-f587a9f5801c tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:51:02.564715 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-7475ee6a-72d4-4ab1-8a99-f587a9f5801c tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] [instance: cb6423bc-f2f9-4346-b85e-1fa80b4e9b97] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:51:02.571200 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7475ee6a-72d4-4ab1-8a99-f587a9f5801c tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:51:02.571652 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7475ee6a-72d4-4ab1-8a99-f587a9f5801c tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:51:02.572418 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7475ee6a-72d4-4ab1-8a99-f587a9f5801c tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:51:02.572839 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-7475ee6a-72d4-4ab1-8a99-f587a9f5801c tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:51:02.604944 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-7475ee6a-72d4-4ab1-8a99-f587a9f5801c tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] 10.222.0.65 "GET /compute/v2.1/servers/cb6423bc-f2f9-4346-b85e-1fa80b4e9b97/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046335 May 19 21:51:02.605497 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 537/1063] 10.222.0.65 () {58 vars in 1301 bytes} [Thu May 19 21:51:02 2022] GET /compute/v2.1/servers/cb6423bc-f2f9-4346-b85e-1fa80b4e9b97/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 21:51:03.618723 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-4e0b8487-279c-46e9-8b4e-a913b2cc7ce1 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:51:03.619793 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-4e0b8487-279c-46e9-8b4e-a913b2cc7ce1 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] [instance: cb6423bc-f2f9-4346-b85e-1fa80b4e9b97] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:51:03.627163 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-4e0b8487-279c-46e9-8b4e-a913b2cc7ce1 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:51:03.627612 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-4e0b8487-279c-46e9-8b4e-a913b2cc7ce1 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:51:03.628373 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-4e0b8487-279c-46e9-8b4e-a913b2cc7ce1 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:51:03.628828 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-4e0b8487-279c-46e9-8b4e-a913b2cc7ce1 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:51:03.663010 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-4e0b8487-279c-46e9-8b4e-a913b2cc7ce1 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] 10.222.0.65 "GET /compute/v2.1/servers/cb6423bc-f2f9-4346-b85e-1fa80b4e9b97/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049293 May 19 21:51:03.663565 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 527/1064] 10.222.0.65 () {58 vars in 1301 bytes} [Thu May 19 21:51:03 2022] GET /compute/v2.1/servers/cb6423bc-f2f9-4346-b85e-1fa80b4e9b97/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 21:51:03.729088 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-620882fc-bf28-4394-8612-907b2506a5f2 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:51:03.729695 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-620882fc-bf28-4394-8612-907b2506a5f2 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] [instance: cb6423bc-f2f9-4346-b85e-1fa80b4e9b97] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:51:03.736973 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-620882fc-bf28-4394-8612-907b2506a5f2 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:51:03.737532 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-620882fc-bf28-4394-8612-907b2506a5f2 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:51:03.738653 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-620882fc-bf28-4394-8612-907b2506a5f2 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:51:03.739087 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-620882fc-bf28-4394-8612-907b2506a5f2 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:51:03.765787 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-620882fc-bf28-4394-8612-907b2506a5f2 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] [instance: cb6423bc-f2f9-4346-b85e-1fa80b4e9b97] Going to try to terminate instance {{(pid=124350) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 21:51:03.859138 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-620882fc-bf28-4394-8612-907b2506a5f2 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] 10.222.0.65 "DELETE /compute/v2.1/servers/cb6423bc-f2f9-4346-b85e-1fa80b4e9b97" status: 204 len: 0 microversion: 2.1 time: 0.133682 May 19 21:51:03.860149 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 538/1065] 10.222.0.65 () {58 vars in 1238 bytes} [Thu May 19 21:51:03 2022] DELETE /compute/v2.1/servers/cb6423bc-f2f9-4346-b85e-1fa80b4e9b97 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 21:51:03.870832 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-251da329-7741-490d-a236-b2d21e62792d tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:51:03.871555 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-251da329-7741-490d-a236-b2d21e62792d tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] [instance: cb6423bc-f2f9-4346-b85e-1fa80b4e9b97] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:51:03.879530 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-251da329-7741-490d-a236-b2d21e62792d tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:51:03.879974 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-251da329-7741-490d-a236-b2d21e62792d tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:51:03.880740 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-251da329-7741-490d-a236-b2d21e62792d tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:51:03.881171 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-251da329-7741-490d-a236-b2d21e62792d tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:51:04.018672 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-251da329-7741-490d-a236-b2d21e62792d tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9bd7a1a0e804d23aaa68153549672c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4ad8679d5446b591d4083529f992cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:51:04.026743 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-251da329-7741-490d-a236-b2d21e62792d tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] 10.222.0.65 "GET /compute/v2.1/servers/cb6423bc-f2f9-4346-b85e-1fa80b4e9b97" status: 200 len: 1682 microversion: 2.1 time: 0.161833 May 19 21:51:04.027298 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 528/1066] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:51:03 2022] GET /compute/v2.1/servers/cb6423bc-f2f9-4346-b85e-1fa80b4e9b97 => generated 1682 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:51:05.045339 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-cdb225d5-5c60-4908-bac9-2f54efde9c6e tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:51:05.046027 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-cdb225d5-5c60-4908-bac9-2f54efde9c6e tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] [instance: cb6423bc-f2f9-4346-b85e-1fa80b4e9b97] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:51:05.053654 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cdb225d5-5c60-4908-bac9-2f54efde9c6e tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:51:05.054106 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cdb225d5-5c60-4908-bac9-2f54efde9c6e tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:51:05.054916 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cdb225d5-5c60-4908-bac9-2f54efde9c6e tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:51:05.055348 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-cdb225d5-5c60-4908-bac9-2f54efde9c6e tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:51:05.201134 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-cdb225d5-5c60-4908-bac9-2f54efde9c6e tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9bd7a1a0e804d23aaa68153549672c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4ad8679d5446b591d4083529f992cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:51:05.210226 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-cdb225d5-5c60-4908-bac9-2f54efde9c6e tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] 10.222.0.65 "GET /compute/v2.1/servers/cb6423bc-f2f9-4346-b85e-1fa80b4e9b97" status: 200 len: 1682 microversion: 2.1 time: 0.169169 May 19 21:51:05.210833 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 539/1067] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:51:05 2022] GET /compute/v2.1/servers/cb6423bc-f2f9-4346-b85e-1fa80b4e9b97 => generated 1682 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:51:06.228335 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-095d6745-1b19-4f22-8a31-297a618775d9 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:51:06.229043 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-095d6745-1b19-4f22-8a31-297a618775d9 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] [instance: cb6423bc-f2f9-4346-b85e-1fa80b4e9b97] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:51:06.236191 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-095d6745-1b19-4f22-8a31-297a618775d9 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:51:06.236658 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-095d6745-1b19-4f22-8a31-297a618775d9 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:51:06.237399 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-095d6745-1b19-4f22-8a31-297a618775d9 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:51:06.237933 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-095d6745-1b19-4f22-8a31-297a618775d9 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:51:06.481426 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-095d6745-1b19-4f22-8a31-297a618775d9 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9bd7a1a0e804d23aaa68153549672c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4ad8679d5446b591d4083529f992cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:51:06.489995 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-095d6745-1b19-4f22-8a31-297a618775d9 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] 10.222.0.65 "GET /compute/v2.1/servers/cb6423bc-f2f9-4346-b85e-1fa80b4e9b97" status: 200 len: 1682 microversion: 2.1 time: 0.265637 May 19 21:51:06.490620 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 529/1068] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:51:06 2022] GET /compute/v2.1/servers/cb6423bc-f2f9-4346-b85e-1fa80b4e9b97 => generated 1682 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 21:51:06.791799 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [req-f8892080-c7c3-4427-a867-78440a034f4b req-e6ad6a84-53af-44e6-8a07-7775aa79bec8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb6423bc-f2f9-4346-b85e-1fa80b4e9b97", "name": "network-vif-deleted", "tag": "cb4f259d-fc85-4e6d-9f30-29b82cfcbd44"}]} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:51:06.803672 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-f8892080-c7c3-4427-a867-78440a034f4b req-e6ad6a84-53af-44e6-8a07-7775aa79bec8 service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:51:06.804145 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-f8892080-c7c3-4427-a867-78440a034f4b req-e6ad6a84-53af-44e6-8a07-7775aa79bec8 service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:51:06.819885 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.compute.server_external_events [req-f8892080-c7c3-4427-a867-78440a034f4b req-e6ad6a84-53af-44e6-8a07-7775aa79bec8 service nova] Creating event network-vif-deleted:cb4f259d-fc85-4e6d-9f30-29b82cfcbd44 for instance cb6423bc-f2f9-4346-b85e-1fa80b4e9b97 on hv-cinder-83563 May 19 21:51:06.825486 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [req-f8892080-c7c3-4427-a867-78440a034f4b req-e6ad6a84-53af-44e6-8a07-7775aa79bec8 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117219 May 19 21:51:06.826100 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 540/1069] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 21:51:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 21:51:07.508545 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-fca8b257-50ee-404e-9c0c-d98670488991 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:51:07.509098 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-fca8b257-50ee-404e-9c0c-d98670488991 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] [instance: cb6423bc-f2f9-4346-b85e-1fa80b4e9b97] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:51:07.516599 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-fca8b257-50ee-404e-9c0c-d98670488991 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:51:07.517170 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-fca8b257-50ee-404e-9c0c-d98670488991 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:51:07.517979 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-fca8b257-50ee-404e-9c0c-d98670488991 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:51:07.518535 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-fca8b257-50ee-404e-9c0c-d98670488991 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:51:07.533984 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.wsgi [None req-fca8b257-50ee-404e-9c0c-d98670488991 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] HTTP exception thrown: Instance cb6423bc-f2f9-4346-b85e-1fa80b4e9b97 could not be found. May 19 21:51:07.535716 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-fca8b257-50ee-404e-9c0c-d98670488991 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Request method failure captured: May 19 21:51:07.535716 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: request: GET /compute/v2.1/servers/cb6423bc-f2f9-4346-b85e-1fa80b4e9b97 HTTP/1.1 May 19 21:51:07.535716 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Accept: application/json May 19 21:51:07.535716 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Accept-Encoding: identity May 19 21:51:07.535716 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Connection: close May 19 21:51:07.535716 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Content-Length: 0 May 19 21:51:07.535716 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Content-Type: application/json May 19 21:51:07.535716 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Host: 10.222.0.65 May 19 21:51:07.535716 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Openstack-System-Scope: None May 19 21:51:07.535716 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: User-Agent: python-urllib3/1.26.9 May 19 21:51:07.535716 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Auth-Token: gAAAAABihro0hjkJU9dn5H_V0BsW6Kiuc0LK2zzds0zMxBbjGHXtL1t0ZqjSlGNcltxwXHoc07BXy5_tlLdRemOLc3ACSGx6_UHrVglb4Wh1urAO678uN1i0U1kqAvWHY9-SCVABYPa39QKPrM5KIO_1WgzSamgvkXnJsmlc1efhwz24mY37XWk May 19 21:51:07.535716 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Domain-Id: None May 19 21:51:07.535716 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Domain-Name: None May 19 21:51:07.535716 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Identity-Status: Confirmed May 19 21:51:07.535716 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Is-Admin-Project: True May 19 21:51:07.535716 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Project-Domain-Id: default May 19 21:51:07.535716 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Project-Domain-Name: Default May 19 21:51:07.535716 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Project-Id: 9a4ad8679d5446b591d4083529f992cc May 19 21:51:07.535716 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Project-Name: tempest-AttachVolumeNegativeTest-1262812511 May 19 21:51:07.535716 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Role: reader,member May 19 21:51:07.535716 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Roles: reader,member May 19 21:51:07.537372 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/9a4ad8679d5446b591d4083529f992cc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/9a4ad8679d5446b591d4083529f992cc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_9a4ad8679d5446b591d4083529f992cc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/9a4ad8679d5446b591d4083529f992cc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}] May 19 21:51:07.537372 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Tenant: tempest-AttachVolumeNegativeTest-1262812511 May 19 21:51:07.537372 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Tenant-Id: 9a4ad8679d5446b591d4083529f992cc May 19 21:51:07.537372 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1262812511 May 19 21:51:07.537372 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-User: tempest-AttachVolumeNegativeTest-1262812511-project May 19 21:51:07.537372 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-User-Domain-Id: default May 19 21:51:07.537372 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-User-Domain-Name: Default May 19 21:51:07.537372 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-User-Id: b9bd7a1a0e804d23aaa68153549672c9 May 19 21:51:07.537372 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-User-Name: tempest-AttachVolumeNegativeTest-1262812511-project May 19 21:51:07.537372 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: method: > May 19 21:51:07.537372 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: exception: Instance cb6423bc-f2f9-4346-b85e-1fa80b4e9b97 could not be found. May 19 21:51:07.537372 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: action_args: {'id': 'cb6423bc-f2f9-4346-b85e-1fa80b4e9b97'} May 19 21:51:07.538287 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 21:51:07.538287 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:51:07.538287 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 21:51:07.538287 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 21:51:07.538287 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 21:51:07.538287 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 21:51:07.538287 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 21:51:07.538287 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 21:51:07.538287 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 21:51:07.538287 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 21:51:07.538287 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb6423bc-f2f9-4346-b85e-1fa80b4e9b97 could not be found. May 19 21:51:07.538287 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:51:07.538287 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 21:51:07.538287 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:51:07.538287 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:51:07.538287 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 21:51:07.538287 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 21:51:07.538287 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 21:51:07.538287 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 21:51:07.538287 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 21:51:07.539693 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 21:51:07.539693 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 21:51:07.539693 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 21:51:07.539693 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 21:51:07.539693 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 21:51:07.539693 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 21:51:07.539693 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 21:51:07.539693 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb6423bc-f2f9-4346-b85e-1fa80b4e9b97 could not be found. May 19 21:51:07.539693 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:51:07.539693 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 21:51:07.539693 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:51:07.539693 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:51:07.539693 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 21:51:07.539693 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 21:51:07.539693 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 21:51:07.539693 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 21:51:07.539693 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb6423bc-f2f9-4346-b85e-1fa80b4e9b97 could not be found. May 19 21:51:07.539693 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:51:07.540924 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-fca8b257-50ee-404e-9c0c-d98670488991 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Returning 404 to user: Instance cb6423bc-f2f9-4346-b85e-1fa80b4e9b97 could not be found. {{(pid=124349) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 21:51:07.540924 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-fca8b257-50ee-404e-9c0c-d98670488991 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] 10.222.0.65 "GET /compute/v2.1/servers/cb6423bc-f2f9-4346-b85e-1fa80b4e9b97" status: 404 len: 111 microversion: 2.1 time: 0.032746 May 19 21:51:07.540924 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 530/1070] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:51:07 2022] GET /compute/v2.1/servers/cb6423bc-f2f9-4346-b85e-1fa80b4e9b97 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 21:51:07.547071 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-d5ffcddf-50dc-456c-a66f-09d37246a286 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Calling method '.version_select at 0x7fe363fc9550>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:51:07.568777 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-d5ffcddf-50dc-456c-a66f-09d37246a286 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1618059623" status: 202 len: 0 microversion: 2.1 time: 0.026102 May 19 21:51:07.569468 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 541/1071] 10.222.0.65 () {58 vars in 1220 bytes} [Thu May 19 21:51:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1618059623 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 21:51:09.633693 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-072bd333-df8c-433b-a4d8-64eaed95640c tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:51:09.634323 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-072bd333-df8c-433b-a4d8-64eaed95640c tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] [instance: cb6423bc-f2f9-4346-b85e-1fa80b4e9b97] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:51:09.641554 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-072bd333-df8c-433b-a4d8-64eaed95640c tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:51:09.641994 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-072bd333-df8c-433b-a4d8-64eaed95640c tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:51:09.642794 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-072bd333-df8c-433b-a4d8-64eaed95640c tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:51:09.643208 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-072bd333-df8c-433b-a4d8-64eaed95640c tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:51:09.657621 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.wsgi [None req-072bd333-df8c-433b-a4d8-64eaed95640c tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] HTTP exception thrown: Instance cb6423bc-f2f9-4346-b85e-1fa80b4e9b97 could not be found. May 19 21:51:09.659198 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-072bd333-df8c-433b-a4d8-64eaed95640c tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Request method failure captured: May 19 21:51:09.659198 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: request: DELETE /compute/v2.1/servers/cb6423bc-f2f9-4346-b85e-1fa80b4e9b97 HTTP/1.1 May 19 21:51:09.659198 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Accept: application/json May 19 21:51:09.659198 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Accept-Encoding: identity May 19 21:51:09.659198 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Connection: close May 19 21:51:09.659198 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Content-Length: 0 May 19 21:51:09.659198 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Content-Type: application/json May 19 21:51:09.659198 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Host: 10.222.0.65 May 19 21:51:09.659198 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Openstack-System-Scope: None May 19 21:51:09.659198 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: User-Agent: python-urllib3/1.26.9 May 19 21:51:09.659198 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Auth-Token: gAAAAABihro0hjkJU9dn5H_V0BsW6Kiuc0LK2zzds0zMxBbjGHXtL1t0ZqjSlGNcltxwXHoc07BXy5_tlLdRemOLc3ACSGx6_UHrVglb4Wh1urAO678uN1i0U1kqAvWHY9-SCVABYPa39QKPrM5KIO_1WgzSamgvkXnJsmlc1efhwz24mY37XWk May 19 21:51:09.659198 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Domain-Id: None May 19 21:51:09.659198 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Domain-Name: None May 19 21:51:09.659198 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Identity-Status: Confirmed May 19 21:51:09.659198 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Is-Admin-Project: True May 19 21:51:09.659198 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Project-Domain-Id: default May 19 21:51:09.659198 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Project-Domain-Name: Default May 19 21:51:09.659198 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Project-Id: 9a4ad8679d5446b591d4083529f992cc May 19 21:51:09.659198 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Project-Name: tempest-AttachVolumeNegativeTest-1262812511 May 19 21:51:09.659198 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Role: reader,member May 19 21:51:09.659198 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Roles: reader,member May 19 21:51:09.660806 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/9a4ad8679d5446b591d4083529f992cc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/9a4ad8679d5446b591d4083529f992cc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_9a4ad8679d5446b591d4083529f992cc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/9a4ad8679d5446b591d4083529f992cc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}] May 19 21:51:09.660806 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Tenant: tempest-AttachVolumeNegativeTest-1262812511 May 19 21:51:09.660806 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Tenant-Id: 9a4ad8679d5446b591d4083529f992cc May 19 21:51:09.660806 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1262812511 May 19 21:51:09.660806 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-User: tempest-AttachVolumeNegativeTest-1262812511-project May 19 21:51:09.660806 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-User-Domain-Id: default May 19 21:51:09.660806 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-User-Domain-Name: Default May 19 21:51:09.660806 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-User-Id: b9bd7a1a0e804d23aaa68153549672c9 May 19 21:51:09.660806 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-User-Name: tempest-AttachVolumeNegativeTest-1262812511-project May 19 21:51:09.660806 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: method: > May 19 21:51:09.660806 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: exception: Instance cb6423bc-f2f9-4346-b85e-1fa80b4e9b97 could not be found. May 19 21:51:09.660806 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: action_args: {'id': 'cb6423bc-f2f9-4346-b85e-1fa80b4e9b97'} May 19 21:51:09.661618 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 21:51:09.661618 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:51:09.661618 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 21:51:09.661618 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 21:51:09.661618 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 21:51:09.661618 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 21:51:09.661618 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 21:51:09.661618 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 21:51:09.661618 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 21:51:09.661618 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 21:51:09.661618 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb6423bc-f2f9-4346-b85e-1fa80b4e9b97 could not be found. May 19 21:51:09.661618 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:51:09.661618 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 21:51:09.661618 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:51:09.661618 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:51:09.661618 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 21:51:09.661618 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 21:51:09.661618 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 21:51:09.661618 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 21:51:09.661618 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 21:51:09.663233 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 21:51:09.663233 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 19 21:51:09.663233 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 21:51:09.663233 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 19 21:51:09.663233 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 21:51:09.663233 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 21:51:09.663233 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 21:51:09.663233 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 21:51:09.663233 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 21:51:09.663233 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb6423bc-f2f9-4346-b85e-1fa80b4e9b97 could not be found. May 19 21:51:09.663233 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:51:09.663233 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 21:51:09.663233 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:51:09.663233 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:51:09.663233 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 21:51:09.663233 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 21:51:09.663233 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 21:51:09.663233 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 21:51:09.663233 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb6423bc-f2f9-4346-b85e-1fa80b4e9b97 could not be found. May 19 21:51:09.663233 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:51:09.664812 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-072bd333-df8c-433b-a4d8-64eaed95640c tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Returning 404 to user: Instance cb6423bc-f2f9-4346-b85e-1fa80b4e9b97 could not be found. {{(pid=124349) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 21:51:09.664812 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-072bd333-df8c-433b-a4d8-64eaed95640c tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] 10.222.0.65 "DELETE /compute/v2.1/servers/cb6423bc-f2f9-4346-b85e-1fa80b4e9b97" status: 404 len: 111 microversion: 2.1 time: 0.031537 May 19 21:51:09.664812 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 531/1072] 10.222.0.65 () {58 vars in 1238 bytes} [Thu May 19 21:51:09 2022] DELETE /compute/v2.1/servers/cb6423bc-f2f9-4346-b85e-1fa80b4e9b97 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 21:51:09.672218 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-a44d63f8-d1c6-406c-8106-fb0f4b942a0a tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:51:09.673384 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-a44d63f8-d1c6-406c-8106-fb0f4b942a0a tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] [instance: cb6423bc-f2f9-4346-b85e-1fa80b4e9b97] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:51:09.683566 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a44d63f8-d1c6-406c-8106-fb0f4b942a0a tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:51:09.684223 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a44d63f8-d1c6-406c-8106-fb0f4b942a0a tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:51:09.685206 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a44d63f8-d1c6-406c-8106-fb0f4b942a0a tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:51:09.685827 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a44d63f8-d1c6-406c-8106-fb0f4b942a0a tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:51:09.701173 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.wsgi [None req-a44d63f8-d1c6-406c-8106-fb0f4b942a0a tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] HTTP exception thrown: Instance cb6423bc-f2f9-4346-b85e-1fa80b4e9b97 could not be found. May 19 21:51:09.703203 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-a44d63f8-d1c6-406c-8106-fb0f4b942a0a tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Request method failure captured: May 19 21:51:09.703203 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: request: GET /compute/v2.1/servers/cb6423bc-f2f9-4346-b85e-1fa80b4e9b97 HTTP/1.1 May 19 21:51:09.703203 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Accept: application/json May 19 21:51:09.703203 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Accept-Encoding: identity May 19 21:51:09.703203 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Connection: close May 19 21:51:09.703203 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Content-Length: 0 May 19 21:51:09.703203 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Content-Type: application/json May 19 21:51:09.703203 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Host: 10.222.0.65 May 19 21:51:09.703203 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Openstack-System-Scope: None May 19 21:51:09.703203 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: User-Agent: python-urllib3/1.26.9 May 19 21:51:09.703203 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Auth-Token: gAAAAABihro0hjkJU9dn5H_V0BsW6Kiuc0LK2zzds0zMxBbjGHXtL1t0ZqjSlGNcltxwXHoc07BXy5_tlLdRemOLc3ACSGx6_UHrVglb4Wh1urAO678uN1i0U1kqAvWHY9-SCVABYPa39QKPrM5KIO_1WgzSamgvkXnJsmlc1efhwz24mY37XWk May 19 21:51:09.703203 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Domain-Id: None May 19 21:51:09.703203 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Domain-Name: None May 19 21:51:09.703203 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Identity-Status: Confirmed May 19 21:51:09.703203 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Is-Admin-Project: True May 19 21:51:09.703203 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Project-Domain-Id: default May 19 21:51:09.703203 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Project-Domain-Name: Default May 19 21:51:09.703203 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Project-Id: 9a4ad8679d5446b591d4083529f992cc May 19 21:51:09.703203 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Project-Name: tempest-AttachVolumeNegativeTest-1262812511 May 19 21:51:09.703203 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Role: reader,member May 19 21:51:09.703203 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Roles: reader,member May 19 21:51:09.704672 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/9a4ad8679d5446b591d4083529f992cc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/9a4ad8679d5446b591d4083529f992cc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_9a4ad8679d5446b591d4083529f992cc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/9a4ad8679d5446b591d4083529f992cc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}] May 19 21:51:09.704672 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Tenant: tempest-AttachVolumeNegativeTest-1262812511 May 19 21:51:09.704672 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Tenant-Id: 9a4ad8679d5446b591d4083529f992cc May 19 21:51:09.704672 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1262812511 May 19 21:51:09.704672 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-User: tempest-AttachVolumeNegativeTest-1262812511-project May 19 21:51:09.704672 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-User-Domain-Id: default May 19 21:51:09.704672 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-User-Domain-Name: Default May 19 21:51:09.704672 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-User-Id: b9bd7a1a0e804d23aaa68153549672c9 May 19 21:51:09.704672 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-User-Name: tempest-AttachVolumeNegativeTest-1262812511-project May 19 21:51:09.704672 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: method: > May 19 21:51:09.704672 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: exception: Instance cb6423bc-f2f9-4346-b85e-1fa80b4e9b97 could not be found. May 19 21:51:09.704672 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: action_args: {'id': 'cb6423bc-f2f9-4346-b85e-1fa80b4e9b97'} May 19 21:51:09.705549 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 21:51:09.705549 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:51:09.705549 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 21:51:09.705549 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 21:51:09.705549 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 21:51:09.705549 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 21:51:09.705549 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 21:51:09.705549 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 21:51:09.705549 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 21:51:09.705549 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 21:51:09.705549 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb6423bc-f2f9-4346-b85e-1fa80b4e9b97 could not be found. May 19 21:51:09.705549 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi May 19 21:51:09.705549 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 21:51:09.705549 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi May 19 21:51:09.705549 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:51:09.705549 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 21:51:09.705549 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 21:51:09.705549 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 21:51:09.705549 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 21:51:09.705549 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 21:51:09.707477 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 21:51:09.707477 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 21:51:09.707477 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 21:51:09.707477 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 21:51:09.707477 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 21:51:09.707477 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 21:51:09.707477 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 21:51:09.707477 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb6423bc-f2f9-4346-b85e-1fa80b4e9b97 could not be found. May 19 21:51:09.707477 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi May 19 21:51:09.707477 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 21:51:09.707477 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi May 19 21:51:09.707477 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:51:09.707477 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 21:51:09.707477 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 21:51:09.707477 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 21:51:09.707477 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 21:51:09.707477 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb6423bc-f2f9-4346-b85e-1fa80b4e9b97 could not be found. May 19 21:51:09.707477 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi May 19 21:51:09.708823 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-a44d63f8-d1c6-406c-8106-fb0f4b942a0a tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Returning 404 to user: Instance cb6423bc-f2f9-4346-b85e-1fa80b4e9b97 could not be found. {{(pid=124350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 21:51:09.708823 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-a44d63f8-d1c6-406c-8106-fb0f4b942a0a tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] 10.222.0.65 "GET /compute/v2.1/servers/cb6423bc-f2f9-4346-b85e-1fa80b4e9b97" status: 404 len: 111 microversion: 2.1 time: 0.038372 May 19 21:51:09.708823 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 542/1073] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:51:09 2022] GET /compute/v2.1/servers/cb6423bc-f2f9-4346-b85e-1fa80b4e9b97 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 21:51:10.850792 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-a4723854-9019-4f10-ad24-89f768519653 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:51:10.851294 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-a4723854-9019-4f10-ad24-89f768519653 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] [instance: 3600a05e-7f64-4e6c-872c-7e0dcf9f34e8] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:51:10.858278 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a4723854-9019-4f10-ad24-89f768519653 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:51:10.858758 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a4723854-9019-4f10-ad24-89f768519653 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:51:10.859509 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a4723854-9019-4f10-ad24-89f768519653 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:51:10.859938 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a4723854-9019-4f10-ad24-89f768519653 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:51:10.873912 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.wsgi [None req-a4723854-9019-4f10-ad24-89f768519653 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] HTTP exception thrown: Instance 3600a05e-7f64-4e6c-872c-7e0dcf9f34e8 could not be found. May 19 21:51:10.875489 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-a4723854-9019-4f10-ad24-89f768519653 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Request method failure captured: May 19 21:51:10.875489 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: request: DELETE /compute/v2.1/servers/3600a05e-7f64-4e6c-872c-7e0dcf9f34e8 HTTP/1.1 May 19 21:51:10.875489 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Accept: application/json May 19 21:51:10.875489 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Accept-Encoding: identity May 19 21:51:10.875489 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Connection: close May 19 21:51:10.875489 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Content-Length: 0 May 19 21:51:10.875489 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Content-Type: application/json May 19 21:51:10.875489 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Host: 10.222.0.65 May 19 21:51:10.875489 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Openstack-System-Scope: None May 19 21:51:10.875489 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: User-Agent: python-urllib3/1.26.9 May 19 21:51:10.875489 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Auth-Token: gAAAAABihro0hjkJU9dn5H_V0BsW6Kiuc0LK2zzds0zMxBbjGHXtL1t0ZqjSlGNcltxwXHoc07BXy5_tlLdRemOLc3ACSGx6_UHrVglb4Wh1urAO678uN1i0U1kqAvWHY9-SCVABYPa39QKPrM5KIO_1WgzSamgvkXnJsmlc1efhwz24mY37XWk May 19 21:51:10.875489 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Domain-Id: None May 19 21:51:10.875489 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Domain-Name: None May 19 21:51:10.875489 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Identity-Status: Confirmed May 19 21:51:10.875489 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Is-Admin-Project: True May 19 21:51:10.875489 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Project-Domain-Id: default May 19 21:51:10.875489 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Project-Domain-Name: Default May 19 21:51:10.875489 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Project-Id: 9a4ad8679d5446b591d4083529f992cc May 19 21:51:10.875489 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Project-Name: tempest-AttachVolumeNegativeTest-1262812511 May 19 21:51:10.875489 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Role: reader,member May 19 21:51:10.875489 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Roles: reader,member May 19 21:51:10.877137 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/9a4ad8679d5446b591d4083529f992cc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/9a4ad8679d5446b591d4083529f992cc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_9a4ad8679d5446b591d4083529f992cc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/9a4ad8679d5446b591d4083529f992cc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}] May 19 21:51:10.877137 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Tenant: tempest-AttachVolumeNegativeTest-1262812511 May 19 21:51:10.877137 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Tenant-Id: 9a4ad8679d5446b591d4083529f992cc May 19 21:51:10.877137 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1262812511 May 19 21:51:10.877137 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-User: tempest-AttachVolumeNegativeTest-1262812511-project May 19 21:51:10.877137 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-User-Domain-Id: default May 19 21:51:10.877137 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-User-Domain-Name: Default May 19 21:51:10.877137 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-User-Id: b9bd7a1a0e804d23aaa68153549672c9 May 19 21:51:10.877137 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-User-Name: tempest-AttachVolumeNegativeTest-1262812511-project May 19 21:51:10.877137 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: method: > May 19 21:51:10.877137 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: exception: Instance 3600a05e-7f64-4e6c-872c-7e0dcf9f34e8 could not be found. May 19 21:51:10.877137 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: action_args: {'id': '3600a05e-7f64-4e6c-872c-7e0dcf9f34e8'} May 19 21:51:10.878057 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 21:51:10.878057 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:51:10.878057 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 21:51:10.878057 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 21:51:10.878057 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 21:51:10.878057 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 21:51:10.878057 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 21:51:10.878057 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 21:51:10.878057 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 21:51:10.878057 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 21:51:10.878057 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3600a05e-7f64-4e6c-872c-7e0dcf9f34e8 could not be found. May 19 21:51:10.878057 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:51:10.878057 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 21:51:10.878057 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:51:10.878057 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:51:10.878057 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 21:51:10.878057 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 21:51:10.878057 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 21:51:10.878057 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 21:51:10.878057 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 21:51:10.879587 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 21:51:10.879587 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 19 21:51:10.879587 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 21:51:10.879587 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 19 21:51:10.879587 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 21:51:10.879587 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 21:51:10.879587 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 21:51:10.879587 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 21:51:10.879587 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 21:51:10.879587 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3600a05e-7f64-4e6c-872c-7e0dcf9f34e8 could not be found. May 19 21:51:10.879587 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:51:10.879587 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 21:51:10.879587 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:51:10.879587 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:51:10.879587 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 21:51:10.879587 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 21:51:10.879587 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 21:51:10.879587 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 21:51:10.879587 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3600a05e-7f64-4e6c-872c-7e0dcf9f34e8 could not be found. May 19 21:51:10.879587 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:51:10.881053 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-a4723854-9019-4f10-ad24-89f768519653 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Returning 404 to user: Instance 3600a05e-7f64-4e6c-872c-7e0dcf9f34e8 could not be found. {{(pid=124349) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 21:51:10.881053 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-a4723854-9019-4f10-ad24-89f768519653 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] 10.222.0.65 "DELETE /compute/v2.1/servers/3600a05e-7f64-4e6c-872c-7e0dcf9f34e8" status: 404 len: 111 microversion: 2.1 time: 0.030189 May 19 21:51:10.881053 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 532/1074] 10.222.0.65 () {58 vars in 1238 bytes} [Thu May 19 21:51:10 2022] DELETE /compute/v2.1/servers/3600a05e-7f64-4e6c-872c-7e0dcf9f34e8 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 21:51:10.885627 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-b5423bb6-8857-42a2-9111-62d77be68034 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:51:10.886232 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-b5423bb6-8857-42a2-9111-62d77be68034 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] [instance: 3600a05e-7f64-4e6c-872c-7e0dcf9f34e8] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:51:10.893279 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b5423bb6-8857-42a2-9111-62d77be68034 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:51:10.893735 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b5423bb6-8857-42a2-9111-62d77be68034 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:51:10.894528 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b5423bb6-8857-42a2-9111-62d77be68034 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:51:10.895215 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-b5423bb6-8857-42a2-9111-62d77be68034 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:51:10.908975 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.wsgi [None req-b5423bb6-8857-42a2-9111-62d77be68034 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] HTTP exception thrown: Instance 3600a05e-7f64-4e6c-872c-7e0dcf9f34e8 could not be found. May 19 21:51:10.910579 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-b5423bb6-8857-42a2-9111-62d77be68034 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Request method failure captured: May 19 21:51:10.910579 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: request: GET /compute/v2.1/servers/3600a05e-7f64-4e6c-872c-7e0dcf9f34e8 HTTP/1.1 May 19 21:51:10.910579 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Accept: application/json May 19 21:51:10.910579 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Accept-Encoding: identity May 19 21:51:10.910579 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Connection: close May 19 21:51:10.910579 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Content-Length: 0 May 19 21:51:10.910579 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Content-Type: application/json May 19 21:51:10.910579 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Host: 10.222.0.65 May 19 21:51:10.910579 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Openstack-System-Scope: None May 19 21:51:10.910579 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: User-Agent: python-urllib3/1.26.9 May 19 21:51:10.910579 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Auth-Token: gAAAAABihro0hjkJU9dn5H_V0BsW6Kiuc0LK2zzds0zMxBbjGHXtL1t0ZqjSlGNcltxwXHoc07BXy5_tlLdRemOLc3ACSGx6_UHrVglb4Wh1urAO678uN1i0U1kqAvWHY9-SCVABYPa39QKPrM5KIO_1WgzSamgvkXnJsmlc1efhwz24mY37XWk May 19 21:51:10.910579 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Domain-Id: None May 19 21:51:10.910579 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Domain-Name: None May 19 21:51:10.910579 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Identity-Status: Confirmed May 19 21:51:10.910579 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Is-Admin-Project: True May 19 21:51:10.910579 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Project-Domain-Id: default May 19 21:51:10.910579 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Project-Domain-Name: Default May 19 21:51:10.910579 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Project-Id: 9a4ad8679d5446b591d4083529f992cc May 19 21:51:10.910579 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Project-Name: tempest-AttachVolumeNegativeTest-1262812511 May 19 21:51:10.910579 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Role: reader,member May 19 21:51:10.910579 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Roles: reader,member May 19 21:51:10.912041 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/9a4ad8679d5446b591d4083529f992cc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/9a4ad8679d5446b591d4083529f992cc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_9a4ad8679d5446b591d4083529f992cc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/9a4ad8679d5446b591d4083529f992cc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}] May 19 21:51:10.912041 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Tenant: tempest-AttachVolumeNegativeTest-1262812511 May 19 21:51:10.912041 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Tenant-Id: 9a4ad8679d5446b591d4083529f992cc May 19 21:51:10.912041 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1262812511 May 19 21:51:10.912041 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-User: tempest-AttachVolumeNegativeTest-1262812511-project May 19 21:51:10.912041 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-User-Domain-Id: default May 19 21:51:10.912041 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-User-Domain-Name: Default May 19 21:51:10.912041 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-User-Id: b9bd7a1a0e804d23aaa68153549672c9 May 19 21:51:10.912041 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-User-Name: tempest-AttachVolumeNegativeTest-1262812511-project May 19 21:51:10.912041 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: method: > May 19 21:51:10.912041 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: exception: Instance 3600a05e-7f64-4e6c-872c-7e0dcf9f34e8 could not be found. May 19 21:51:10.912041 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: action_args: {'id': '3600a05e-7f64-4e6c-872c-7e0dcf9f34e8'} May 19 21:51:10.913019 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 21:51:10.913019 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:51:10.913019 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 21:51:10.913019 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 21:51:10.913019 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 21:51:10.913019 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 21:51:10.913019 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 21:51:10.913019 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 21:51:10.913019 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 21:51:10.913019 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 21:51:10.913019 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3600a05e-7f64-4e6c-872c-7e0dcf9f34e8 could not be found. May 19 21:51:10.913019 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi May 19 21:51:10.913019 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 21:51:10.913019 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi May 19 21:51:10.913019 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:51:10.913019 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 21:51:10.913019 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 21:51:10.913019 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 21:51:10.913019 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 21:51:10.913019 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 21:51:10.914586 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 21:51:10.914586 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 21:51:10.914586 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 21:51:10.914586 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 21:51:10.914586 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 21:51:10.914586 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 21:51:10.914586 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 21:51:10.914586 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3600a05e-7f64-4e6c-872c-7e0dcf9f34e8 could not be found. May 19 21:51:10.914586 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi May 19 21:51:10.914586 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 21:51:10.914586 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi May 19 21:51:10.914586 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:51:10.914586 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 21:51:10.914586 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 21:51:10.914586 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 21:51:10.914586 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 21:51:10.914586 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3600a05e-7f64-4e6c-872c-7e0dcf9f34e8 could not be found. May 19 21:51:10.914586 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi May 19 21:51:10.915979 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-b5423bb6-8857-42a2-9111-62d77be68034 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Returning 404 to user: Instance 3600a05e-7f64-4e6c-872c-7e0dcf9f34e8 could not be found. {{(pid=124350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 21:51:10.915979 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-b5423bb6-8857-42a2-9111-62d77be68034 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] 10.222.0.65 "GET /compute/v2.1/servers/3600a05e-7f64-4e6c-872c-7e0dcf9f34e8" status: 404 len: 111 microversion: 2.1 time: 0.030185 May 19 21:51:10.915979 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 543/1075] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:51:10 2022] GET /compute/v2.1/servers/3600a05e-7f64-4e6c-872c-7e0dcf9f34e8 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 21:51:10.920569 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-e3cd88f9-29b5-4c37-8134-ab0684e9e830 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:51:10.921188 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-e3cd88f9-29b5-4c37-8134-ab0684e9e830 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] [instance: b9d58902-c539-4c3e-8a00-b1aeb2cb9c52] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:51:10.927855 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e3cd88f9-29b5-4c37-8134-ab0684e9e830 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:51:10.928300 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e3cd88f9-29b5-4c37-8134-ab0684e9e830 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:51:10.929055 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e3cd88f9-29b5-4c37-8134-ab0684e9e830 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:51:10.929483 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-e3cd88f9-29b5-4c37-8134-ab0684e9e830 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:51:10.943387 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.wsgi [None req-e3cd88f9-29b5-4c37-8134-ab0684e9e830 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] HTTP exception thrown: Instance b9d58902-c539-4c3e-8a00-b1aeb2cb9c52 could not be found. May 19 21:51:10.944926 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-e3cd88f9-29b5-4c37-8134-ab0684e9e830 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Request method failure captured: May 19 21:51:10.944926 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: request: DELETE /compute/v2.1/servers/b9d58902-c539-4c3e-8a00-b1aeb2cb9c52 HTTP/1.1 May 19 21:51:10.944926 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Accept: application/json May 19 21:51:10.944926 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Accept-Encoding: identity May 19 21:51:10.944926 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Connection: close May 19 21:51:10.944926 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Content-Length: 0 May 19 21:51:10.944926 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Content-Type: application/json May 19 21:51:10.944926 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Host: 10.222.0.65 May 19 21:51:10.944926 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Openstack-System-Scope: None May 19 21:51:10.944926 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: User-Agent: python-urllib3/1.26.9 May 19 21:51:10.944926 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Auth-Token: gAAAAABihro0hjkJU9dn5H_V0BsW6Kiuc0LK2zzds0zMxBbjGHXtL1t0ZqjSlGNcltxwXHoc07BXy5_tlLdRemOLc3ACSGx6_UHrVglb4Wh1urAO678uN1i0U1kqAvWHY9-SCVABYPa39QKPrM5KIO_1WgzSamgvkXnJsmlc1efhwz24mY37XWk May 19 21:51:10.944926 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Domain-Id: None May 19 21:51:10.944926 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Domain-Name: None May 19 21:51:10.944926 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Identity-Status: Confirmed May 19 21:51:10.944926 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Is-Admin-Project: True May 19 21:51:10.944926 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Project-Domain-Id: default May 19 21:51:10.944926 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Project-Domain-Name: Default May 19 21:51:10.944926 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Project-Id: 9a4ad8679d5446b591d4083529f992cc May 19 21:51:10.944926 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Project-Name: tempest-AttachVolumeNegativeTest-1262812511 May 19 21:51:10.944926 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Role: reader,member May 19 21:51:10.944926 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Roles: reader,member May 19 21:51:10.946600 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/9a4ad8679d5446b591d4083529f992cc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/9a4ad8679d5446b591d4083529f992cc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_9a4ad8679d5446b591d4083529f992cc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/9a4ad8679d5446b591d4083529f992cc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}] May 19 21:51:10.946600 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Tenant: tempest-AttachVolumeNegativeTest-1262812511 May 19 21:51:10.946600 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Tenant-Id: 9a4ad8679d5446b591d4083529f992cc May 19 21:51:10.946600 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1262812511 May 19 21:51:10.946600 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-User: tempest-AttachVolumeNegativeTest-1262812511-project May 19 21:51:10.946600 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-User-Domain-Id: default May 19 21:51:10.946600 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-User-Domain-Name: Default May 19 21:51:10.946600 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-User-Id: b9bd7a1a0e804d23aaa68153549672c9 May 19 21:51:10.946600 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-User-Name: tempest-AttachVolumeNegativeTest-1262812511-project May 19 21:51:10.946600 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: method: > May 19 21:51:10.946600 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: exception: Instance b9d58902-c539-4c3e-8a00-b1aeb2cb9c52 could not be found. May 19 21:51:10.946600 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: action_args: {'id': 'b9d58902-c539-4c3e-8a00-b1aeb2cb9c52'} May 19 21:51:10.947656 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 21:51:10.947656 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:51:10.947656 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 21:51:10.947656 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 21:51:10.947656 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 21:51:10.947656 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 21:51:10.947656 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 21:51:10.947656 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 21:51:10.947656 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 21:51:10.947656 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 21:51:10.947656 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9d58902-c539-4c3e-8a00-b1aeb2cb9c52 could not be found. May 19 21:51:10.947656 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:51:10.947656 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 21:51:10.947656 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:51:10.947656 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:51:10.947656 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 21:51:10.947656 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 21:51:10.947656 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 21:51:10.947656 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 21:51:10.947656 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 21:51:10.949150 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 21:51:10.949150 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 19 21:51:10.949150 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 21:51:10.949150 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 19 21:51:10.949150 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 21:51:10.949150 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 21:51:10.949150 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 21:51:10.949150 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 21:51:10.949150 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 21:51:10.949150 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9d58902-c539-4c3e-8a00-b1aeb2cb9c52 could not be found. May 19 21:51:10.949150 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:51:10.949150 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 21:51:10.949150 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:51:10.949150 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:51:10.949150 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 21:51:10.949150 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 21:51:10.949150 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 21:51:10.949150 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 21:51:10.949150 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9d58902-c539-4c3e-8a00-b1aeb2cb9c52 could not be found. May 19 21:51:10.949150 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:51:10.950840 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-e3cd88f9-29b5-4c37-8134-ab0684e9e830 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Returning 404 to user: Instance b9d58902-c539-4c3e-8a00-b1aeb2cb9c52 could not be found. {{(pid=124349) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 21:51:10.950840 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-e3cd88f9-29b5-4c37-8134-ab0684e9e830 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] 10.222.0.65 "DELETE /compute/v2.1/servers/b9d58902-c539-4c3e-8a00-b1aeb2cb9c52" status: 404 len: 111 microversion: 2.1 time: 0.029654 May 19 21:51:10.950840 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 533/1076] 10.222.0.65 () {58 vars in 1238 bytes} [Thu May 19 21:51:10 2022] DELETE /compute/v2.1/servers/b9d58902-c539-4c3e-8a00-b1aeb2cb9c52 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 21:51:10.955301 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-a5e9f063-0969-4cd6-b68c-788aa8c584f6 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:51:10.955911 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-a5e9f063-0969-4cd6-b68c-788aa8c584f6 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] [instance: b9d58902-c539-4c3e-8a00-b1aeb2cb9c52] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:51:10.966784 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a5e9f063-0969-4cd6-b68c-788aa8c584f6 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:51:10.967221 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a5e9f063-0969-4cd6-b68c-788aa8c584f6 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:51:10.968041 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a5e9f063-0969-4cd6-b68c-788aa8c584f6 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:51:10.968468 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-a5e9f063-0969-4cd6-b68c-788aa8c584f6 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:51:10.985054 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.wsgi [None req-a5e9f063-0969-4cd6-b68c-788aa8c584f6 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] HTTP exception thrown: Instance b9d58902-c539-4c3e-8a00-b1aeb2cb9c52 could not be found. May 19 21:51:10.986609 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-a5e9f063-0969-4cd6-b68c-788aa8c584f6 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Request method failure captured: May 19 21:51:10.986609 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: request: GET /compute/v2.1/servers/b9d58902-c539-4c3e-8a00-b1aeb2cb9c52 HTTP/1.1 May 19 21:51:10.986609 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Accept: application/json May 19 21:51:10.986609 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Accept-Encoding: identity May 19 21:51:10.986609 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Connection: close May 19 21:51:10.986609 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Content-Length: 0 May 19 21:51:10.986609 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Content-Type: application/json May 19 21:51:10.986609 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Host: 10.222.0.65 May 19 21:51:10.986609 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Openstack-System-Scope: None May 19 21:51:10.986609 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: User-Agent: python-urllib3/1.26.9 May 19 21:51:10.986609 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Auth-Token: gAAAAABihro0hjkJU9dn5H_V0BsW6Kiuc0LK2zzds0zMxBbjGHXtL1t0ZqjSlGNcltxwXHoc07BXy5_tlLdRemOLc3ACSGx6_UHrVglb4Wh1urAO678uN1i0U1kqAvWHY9-SCVABYPa39QKPrM5KIO_1WgzSamgvkXnJsmlc1efhwz24mY37XWk May 19 21:51:10.986609 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Domain-Id: None May 19 21:51:10.986609 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Domain-Name: None May 19 21:51:10.986609 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Identity-Status: Confirmed May 19 21:51:10.986609 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Is-Admin-Project: True May 19 21:51:10.986609 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Project-Domain-Id: default May 19 21:51:10.986609 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Project-Domain-Name: Default May 19 21:51:10.986609 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Project-Id: 9a4ad8679d5446b591d4083529f992cc May 19 21:51:10.986609 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Project-Name: tempest-AttachVolumeNegativeTest-1262812511 May 19 21:51:10.986609 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Role: reader,member May 19 21:51:10.986609 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Roles: reader,member May 19 21:51:10.988148 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/9a4ad8679d5446b591d4083529f992cc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/9a4ad8679d5446b591d4083529f992cc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_9a4ad8679d5446b591d4083529f992cc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/9a4ad8679d5446b591d4083529f992cc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}] May 19 21:51:10.988148 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Tenant: tempest-AttachVolumeNegativeTest-1262812511 May 19 21:51:10.988148 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Tenant-Id: 9a4ad8679d5446b591d4083529f992cc May 19 21:51:10.988148 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1262812511 May 19 21:51:10.988148 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-User: tempest-AttachVolumeNegativeTest-1262812511-project May 19 21:51:10.988148 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-User-Domain-Id: default May 19 21:51:10.988148 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-User-Domain-Name: Default May 19 21:51:10.988148 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-User-Id: b9bd7a1a0e804d23aaa68153549672c9 May 19 21:51:10.988148 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-User-Name: tempest-AttachVolumeNegativeTest-1262812511-project May 19 21:51:10.988148 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: method: > May 19 21:51:10.988148 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: exception: Instance b9d58902-c539-4c3e-8a00-b1aeb2cb9c52 could not be found. May 19 21:51:10.988148 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: action_args: {'id': 'b9d58902-c539-4c3e-8a00-b1aeb2cb9c52'} May 19 21:51:10.989741 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 21:51:10.989741 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:51:10.989741 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 21:51:10.989741 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 21:51:10.989741 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 21:51:10.989741 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 21:51:10.989741 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 21:51:10.989741 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 21:51:10.989741 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 21:51:10.989741 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 21:51:10.989741 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9d58902-c539-4c3e-8a00-b1aeb2cb9c52 could not be found. May 19 21:51:10.989741 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi May 19 21:51:10.989741 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 21:51:10.989741 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi May 19 21:51:10.989741 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:51:10.989741 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 21:51:10.989741 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 21:51:10.989741 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 21:51:10.989741 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 21:51:10.989741 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 21:51:10.992112 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 21:51:10.992112 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 21:51:10.992112 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 21:51:10.992112 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 21:51:10.992112 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 21:51:10.992112 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 21:51:10.992112 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 21:51:10.992112 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9d58902-c539-4c3e-8a00-b1aeb2cb9c52 could not be found. May 19 21:51:10.992112 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi May 19 21:51:10.992112 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 21:51:10.992112 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi May 19 21:51:10.992112 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:51:10.992112 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 21:51:10.992112 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 21:51:10.992112 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 21:51:10.992112 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 21:51:10.992112 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9d58902-c539-4c3e-8a00-b1aeb2cb9c52 could not be found. May 19 21:51:10.992112 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi May 19 21:51:10.994073 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-a5e9f063-0969-4cd6-b68c-788aa8c584f6 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Returning 404 to user: Instance b9d58902-c539-4c3e-8a00-b1aeb2cb9c52 could not be found. {{(pid=124350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 21:51:10.994073 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-a5e9f063-0969-4cd6-b68c-788aa8c584f6 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] 10.222.0.65 "GET /compute/v2.1/servers/b9d58902-c539-4c3e-8a00-b1aeb2cb9c52" status: 404 len: 111 microversion: 2.1 time: 0.036885 May 19 21:51:10.994073 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 544/1077] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:51:10 2022] GET /compute/v2.1/servers/b9d58902-c539-4c3e-8a00-b1aeb2cb9c52 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 21:51:12.141793 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-148d9b9f-3dbf-4522-91fd-e92c88f1fa0d tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:51:12.142344 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-148d9b9f-3dbf-4522-91fd-e92c88f1fa0d tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] [instance: 2d071024-fffe-422f-9730-0f429f40221b] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:51:12.149243 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-148d9b9f-3dbf-4522-91fd-e92c88f1fa0d tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:51:12.149694 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-148d9b9f-3dbf-4522-91fd-e92c88f1fa0d tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:51:12.150503 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-148d9b9f-3dbf-4522-91fd-e92c88f1fa0d tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:51:12.150927 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-148d9b9f-3dbf-4522-91fd-e92c88f1fa0d tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:51:12.165795 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.wsgi [None req-148d9b9f-3dbf-4522-91fd-e92c88f1fa0d tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] HTTP exception thrown: Instance 2d071024-fffe-422f-9730-0f429f40221b could not be found. May 19 21:51:12.167374 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-148d9b9f-3dbf-4522-91fd-e92c88f1fa0d tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Request method failure captured: May 19 21:51:12.167374 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: request: DELETE /compute/v2.1/servers/2d071024-fffe-422f-9730-0f429f40221b HTTP/1.1 May 19 21:51:12.167374 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Accept: application/json May 19 21:51:12.167374 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Accept-Encoding: identity May 19 21:51:12.167374 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Connection: close May 19 21:51:12.167374 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Content-Length: 0 May 19 21:51:12.167374 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Content-Type: application/json May 19 21:51:12.167374 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Host: 10.222.0.65 May 19 21:51:12.167374 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Openstack-System-Scope: None May 19 21:51:12.167374 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: User-Agent: python-urllib3/1.26.9 May 19 21:51:12.167374 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Auth-Token: gAAAAABihro0hjkJU9dn5H_V0BsW6Kiuc0LK2zzds0zMxBbjGHXtL1t0ZqjSlGNcltxwXHoc07BXy5_tlLdRemOLc3ACSGx6_UHrVglb4Wh1urAO678uN1i0U1kqAvWHY9-SCVABYPa39QKPrM5KIO_1WgzSamgvkXnJsmlc1efhwz24mY37XWk May 19 21:51:12.167374 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Domain-Id: None May 19 21:51:12.167374 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Domain-Name: None May 19 21:51:12.167374 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Identity-Status: Confirmed May 19 21:51:12.167374 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Is-Admin-Project: True May 19 21:51:12.167374 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Project-Domain-Id: default May 19 21:51:12.167374 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Project-Domain-Name: Default May 19 21:51:12.167374 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Project-Id: 9a4ad8679d5446b591d4083529f992cc May 19 21:51:12.167374 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Project-Name: tempest-AttachVolumeNegativeTest-1262812511 May 19 21:51:12.167374 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Role: reader,member May 19 21:51:12.167374 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Roles: reader,member May 19 21:51:12.168888 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/9a4ad8679d5446b591d4083529f992cc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/9a4ad8679d5446b591d4083529f992cc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_9a4ad8679d5446b591d4083529f992cc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/9a4ad8679d5446b591d4083529f992cc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}] May 19 21:51:12.168888 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Tenant: tempest-AttachVolumeNegativeTest-1262812511 May 19 21:51:12.168888 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Tenant-Id: 9a4ad8679d5446b591d4083529f992cc May 19 21:51:12.168888 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1262812511 May 19 21:51:12.168888 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-User: tempest-AttachVolumeNegativeTest-1262812511-project May 19 21:51:12.168888 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-User-Domain-Id: default May 19 21:51:12.168888 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-User-Domain-Name: Default May 19 21:51:12.168888 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-User-Id: b9bd7a1a0e804d23aaa68153549672c9 May 19 21:51:12.168888 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: X-User-Name: tempest-AttachVolumeNegativeTest-1262812511-project May 19 21:51:12.168888 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: method: > May 19 21:51:12.168888 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: exception: Instance 2d071024-fffe-422f-9730-0f429f40221b could not be found. May 19 21:51:12.168888 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: action_args: {'id': '2d071024-fffe-422f-9730-0f429f40221b'} May 19 21:51:12.169701 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 21:51:12.169701 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:51:12.169701 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 21:51:12.169701 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 21:51:12.169701 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 21:51:12.169701 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 21:51:12.169701 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 21:51:12.169701 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 21:51:12.169701 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 21:51:12.169701 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 21:51:12.169701 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d071024-fffe-422f-9730-0f429f40221b could not be found. May 19 21:51:12.169701 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:51:12.169701 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 21:51:12.169701 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:51:12.169701 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:51:12.169701 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 21:51:12.169701 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 21:51:12.169701 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 21:51:12.169701 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 21:51:12.169701 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 21:51:12.171391 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 21:51:12.171391 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 19 21:51:12.171391 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 21:51:12.171391 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 19 21:51:12.171391 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 21:51:12.171391 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 21:51:12.171391 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 21:51:12.171391 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 21:51:12.171391 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 21:51:12.171391 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d071024-fffe-422f-9730-0f429f40221b could not be found. May 19 21:51:12.171391 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:51:12.171391 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 21:51:12.171391 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:51:12.171391 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:51:12.171391 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 21:51:12.171391 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 21:51:12.171391 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 21:51:12.171391 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 21:51:12.171391 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d071024-fffe-422f-9730-0f429f40221b could not be found. May 19 21:51:12.171391 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: ERROR nova.api.openstack.wsgi May 19 21:51:12.173093 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-148d9b9f-3dbf-4522-91fd-e92c88f1fa0d tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Returning 404 to user: Instance 2d071024-fffe-422f-9730-0f429f40221b could not be found. {{(pid=124349) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 21:51:12.173093 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-148d9b9f-3dbf-4522-91fd-e92c88f1fa0d tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] 10.222.0.65 "DELETE /compute/v2.1/servers/2d071024-fffe-422f-9730-0f429f40221b" status: 404 len: 111 microversion: 2.1 time: 0.030904 May 19 21:51:12.173093 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 534/1078] 10.222.0.65 () {58 vars in 1238 bytes} [Thu May 19 21:51:12 2022] DELETE /compute/v2.1/servers/2d071024-fffe-422f-9730-0f429f40221b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 21:51:12.178131 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-0053d924-3dcf-4853-b014-97bc8ff66e68 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:51:12.178772 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-0053d924-3dcf-4853-b014-97bc8ff66e68 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] [instance: 2d071024-fffe-422f-9730-0f429f40221b] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:51:12.185286 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0053d924-3dcf-4853-b014-97bc8ff66e68 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:51:12.185728 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0053d924-3dcf-4853-b014-97bc8ff66e68 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:51:12.186519 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0053d924-3dcf-4853-b014-97bc8ff66e68 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:51:12.186943 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0053d924-3dcf-4853-b014-97bc8ff66e68 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:51:12.200970 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.wsgi [None req-0053d924-3dcf-4853-b014-97bc8ff66e68 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] HTTP exception thrown: Instance 2d071024-fffe-422f-9730-0f429f40221b could not be found. May 19 21:51:12.202845 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-0053d924-3dcf-4853-b014-97bc8ff66e68 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Request method failure captured: May 19 21:51:12.202845 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: request: GET /compute/v2.1/servers/2d071024-fffe-422f-9730-0f429f40221b HTTP/1.1 May 19 21:51:12.202845 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Accept: application/json May 19 21:51:12.202845 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Accept-Encoding: identity May 19 21:51:12.202845 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Connection: close May 19 21:51:12.202845 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Content-Length: 0 May 19 21:51:12.202845 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Content-Type: application/json May 19 21:51:12.202845 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Host: 10.222.0.65 May 19 21:51:12.202845 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Openstack-System-Scope: None May 19 21:51:12.202845 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: User-Agent: python-urllib3/1.26.9 May 19 21:51:12.202845 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Auth-Token: gAAAAABihro0hjkJU9dn5H_V0BsW6Kiuc0LK2zzds0zMxBbjGHXtL1t0ZqjSlGNcltxwXHoc07BXy5_tlLdRemOLc3ACSGx6_UHrVglb4Wh1urAO678uN1i0U1kqAvWHY9-SCVABYPa39QKPrM5KIO_1WgzSamgvkXnJsmlc1efhwz24mY37XWk May 19 21:51:12.202845 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Domain-Id: None May 19 21:51:12.202845 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Domain-Name: None May 19 21:51:12.202845 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Identity-Status: Confirmed May 19 21:51:12.202845 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Is-Admin-Project: True May 19 21:51:12.202845 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Project-Domain-Id: default May 19 21:51:12.202845 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Project-Domain-Name: Default May 19 21:51:12.202845 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Project-Id: 9a4ad8679d5446b591d4083529f992cc May 19 21:51:12.202845 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Project-Name: tempest-AttachVolumeNegativeTest-1262812511 May 19 21:51:12.202845 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Role: reader,member May 19 21:51:12.202845 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Roles: reader,member May 19 21:51:12.204363 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/9a4ad8679d5446b591d4083529f992cc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/9a4ad8679d5446b591d4083529f992cc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_9a4ad8679d5446b591d4083529f992cc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/9a4ad8679d5446b591d4083529f992cc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}] May 19 21:51:12.204363 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Tenant: tempest-AttachVolumeNegativeTest-1262812511 May 19 21:51:12.204363 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Tenant-Id: 9a4ad8679d5446b591d4083529f992cc May 19 21:51:12.204363 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1262812511 May 19 21:51:12.204363 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-User: tempest-AttachVolumeNegativeTest-1262812511-project May 19 21:51:12.204363 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-User-Domain-Id: default May 19 21:51:12.204363 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-User-Domain-Name: Default May 19 21:51:12.204363 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-User-Id: b9bd7a1a0e804d23aaa68153549672c9 May 19 21:51:12.204363 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-User-Name: tempest-AttachVolumeNegativeTest-1262812511-project May 19 21:51:12.204363 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: method: > May 19 21:51:12.204363 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: exception: Instance 2d071024-fffe-422f-9730-0f429f40221b could not be found. May 19 21:51:12.204363 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: action_args: {'id': '2d071024-fffe-422f-9730-0f429f40221b'} May 19 21:51:12.205191 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 21:51:12.205191 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:51:12.205191 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 21:51:12.205191 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 21:51:12.205191 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 21:51:12.205191 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 21:51:12.205191 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 21:51:12.205191 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 21:51:12.205191 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 21:51:12.205191 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 21:51:12.205191 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d071024-fffe-422f-9730-0f429f40221b could not be found. May 19 21:51:12.205191 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi May 19 21:51:12.205191 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 21:51:12.205191 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi May 19 21:51:12.205191 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:51:12.205191 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 21:51:12.205191 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 21:51:12.205191 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 21:51:12.205191 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 21:51:12.205191 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 21:51:12.206466 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 21:51:12.206466 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 21:51:12.206466 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 21:51:12.206466 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 21:51:12.206466 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 21:51:12.206466 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 21:51:12.206466 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 21:51:12.206466 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d071024-fffe-422f-9730-0f429f40221b could not be found. May 19 21:51:12.206466 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi May 19 21:51:12.206466 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 21:51:12.206466 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi May 19 21:51:12.206466 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:51:12.206466 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 21:51:12.206466 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 21:51:12.206466 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 21:51:12.206466 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 21:51:12.206466 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d071024-fffe-422f-9730-0f429f40221b could not be found. May 19 21:51:12.206466 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi May 19 21:51:12.207857 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-0053d924-3dcf-4853-b014-97bc8ff66e68 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] Returning 404 to user: Instance 2d071024-fffe-422f-9730-0f429f40221b could not be found. {{(pid=124350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 21:51:12.207857 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-0053d924-3dcf-4853-b014-97bc8ff66e68 tempest-AttachVolumeNegativeTest-1262812511 tempest-AttachVolumeNegativeTest-1262812511-project] 10.222.0.65 "GET /compute/v2.1/servers/2d071024-fffe-422f-9730-0f429f40221b" status: 404 len: 111 microversion: 2.1 time: 0.030673 May 19 21:51:12.207857 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 545/1079] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:51:12 2022] GET /compute/v2.1/servers/2d071024-fffe-422f-9730-0f429f40221b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 21:51:17.989669 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-b1ca3f10-3a53-4ca0-8a59-05d7245d036b tempest-VolumesTestJSON-1597765651 tempest-VolumesTestJSON-1597765651-project] Calling method '.version_select at 0x7fe3636b2c10>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:51:18.042291 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-b1ca3f10-3a53-4ca0-8a59-05d7245d036b tempest-VolumesTestJSON-1597765651 tempest-VolumesTestJSON-1597765651-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/05a50cbc-b9aa-45fb-9f67-9b1aa34f6cbb" status: 200 len: 351 microversion: 2.1 time: 0.056533 May 19 21:51:18.042861 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 535/1080] 10.222.0.65 () {58 vars in 1244 bytes} [Thu May 19 21:51:17 2022] GET /compute/v2.1/os-volumes/05a50cbc-b9aa-45fb-9f67-9b1aa34f6cbb => generated 351 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 21:51:19.382165 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-1f9ec815-cc1a-4813-83b1-f4b5a94a4fc1 tempest-VolumesTestJSON-1597765651 tempest-VolumesTestJSON-1597765651-project] Calling method '.version_select at 0x7fe3680100d0>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:51:19.432115 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-1f9ec815-cc1a-4813-83b1-f4b5a94a4fc1 tempest-VolumesTestJSON-1597765651 tempest-VolumesTestJSON-1597765651-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/498bc230-2846-417e-86e0-1b808bde31e7" status: 200 len: 350 microversion: 2.1 time: 0.055893 May 19 21:51:19.432827 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 546/1081] 10.222.0.65 () {58 vars in 1244 bytes} [Thu May 19 21:51:19 2022] GET /compute/v2.1/os-volumes/498bc230-2846-417e-86e0-1b808bde31e7 => generated 350 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 21:51:20.776358 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-b3d36bbf-4e4f-4177-88ab-82d07556823e tempest-VolumesTestJSON-1597765651 tempest-VolumesTestJSON-1597765651-project] Calling method '.version_select at 0x7fe36c90f670>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:51:20.826867 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-b3d36bbf-4e4f-4177-88ab-82d07556823e tempest-VolumesTestJSON-1597765651 tempest-VolumesTestJSON-1597765651-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/563a3ee2-d5c5-44f6-bb0b-3d487802110f" status: 200 len: 351 microversion: 2.1 time: 0.054773 May 19 21:51:20.827437 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 536/1082] 10.222.0.65 () {58 vars in 1244 bytes} [Thu May 19 21:51:20 2022] GET /compute/v2.1/os-volumes/563a3ee2-d5c5-44f6-bb0b-3d487802110f => generated 351 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 21:51:20.840191 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-9c7dc24a-c0f6-4163-b684-e775801ee6b2 tempest-VolumesTestJSON-1597765651 tempest-VolumesTestJSON-1597765651-project] Calling method '.version_select at 0x7fe36805dd30>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:51:20.920112 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-9c7dc24a-c0f6-4163-b684-e775801ee6b2 tempest-VolumesTestJSON-1597765651 tempest-VolumesTestJSON-1597765651-project] 10.222.0.65 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.084732 May 19 21:51:20.920678 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 547/1083] 10.222.0.65 () {58 vars in 1133 bytes} [Thu May 19 21:51:20 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:51:20.932963 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-dc3c8574-d83e-4821-89b9-6ce7af35ee9e tempest-VolumesTestJSON-1597765651 tempest-VolumesTestJSON-1597765651-project] Calling method '.version_select at 0x7fe36c8d1ca0>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:51:21.018301 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-dc3c8574-d83e-4821-89b9-6ce7af35ee9e tempest-VolumesTestJSON-1597765651 tempest-VolumesTestJSON-1597765651-project] 10.222.0.65 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.088771 May 19 21:51:21.019180 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 537/1084] 10.222.0.65 () {58 vars in 1148 bytes} [Thu May 19 21:51:20 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 21:51:21.035278 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-879efcd5-beca-4a28-8b2e-26ac41b9b635 tempest-VolumesTestJSON-1597765651 tempest-VolumesTestJSON-1597765651-project] Calling method '.version_select at 0x7fe368064940>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:51:21.119667 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-879efcd5-beca-4a28-8b2e-26ac41b9b635 tempest-VolumesTestJSON-1597765651 tempest-VolumesTestJSON-1597765651-project] 10.222.0.65 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.089525 May 19 21:51:21.120229 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 548/1085] 10.222.0.65 () {58 vars in 1133 bytes} [Thu May 19 21:51:21 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:51:21.132547 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-21be19bf-e772-4c09-9664-babe070ae72b tempest-VolumesTestJSON-1597765651 tempest-VolumesTestJSON-1597765651-project] Calling method '.version_select at 0x7fe36c90f160>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:51:21.215476 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-21be19bf-e772-4c09-9664-babe070ae72b tempest-VolumesTestJSON-1597765651 tempest-VolumesTestJSON-1597765651-project] 10.222.0.65 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.086919 May 19 21:51:21.216086 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 538/1086] 10.222.0.65 () {58 vars in 1166 bytes} [Thu May 19 21:51:21 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 21:51:21.227839 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-d0dfaf9b-3a0b-4c99-81b8-7583a54b83ec tempest-VolumesTestJSON-1597765651 tempest-VolumesTestJSON-1597765651-project] Calling method '.version_select at 0x7fe368080e50>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:51:21.314633 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-d0dfaf9b-3a0b-4c99-81b8-7583a54b83ec tempest-VolumesTestJSON-1597765651 tempest-VolumesTestJSON-1597765651-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.090680 May 19 21:51:21.315206 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 549/1087] 10.222.0.65 () {58 vars in 1169 bytes} [Thu May 19 21:51:21 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 21:51:21.327323 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-c6a11231-7b04-4ca2-b85a-100166ab859b tempest-VolumesTestJSON-1597765651 tempest-VolumesTestJSON-1597765651-project] Calling method '.version_select at 0x7fe3637609d0>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:51:21.408107 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-c6a11231-7b04-4ca2-b85a-100166ab859b tempest-VolumesTestJSON-1597765651 tempest-VolumesTestJSON-1597765651-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.084482 May 19 21:51:21.408671 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 539/1088] 10.222.0.65 () {58 vars in 1154 bytes} [Thu May 19 21:51:21 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:51:21.420517 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-04bfbabf-f6e7-4fe2-b503-d78a206c2ed7 tempest-VolumesTestJSON-1597765651 tempest-VolumesTestJSON-1597765651-project] Calling method '.version_select at 0x7fe3636829d0>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:51:21.502981 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-04bfbabf-f6e7-4fe2-b503-d78a206c2ed7 tempest-VolumesTestJSON-1597765651 tempest-VolumesTestJSON-1597765651-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.085957 May 19 21:51:21.503790 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 550/1089] 10.222.0.65 () {58 vars in 1187 bytes} [Thu May 19 21:51:21 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 21:51:21.517210 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-a952eb31-33fe-4170-9390-41aa8858878a tempest-VolumesTestJSON-1597765651 tempest-VolumesTestJSON-1597765651-project] Calling method '.version_select at 0x7fe36c8d1790>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:51:21.597304 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-a952eb31-33fe-4170-9390-41aa8858878a tempest-VolumesTestJSON-1597765651 tempest-VolumesTestJSON-1597765651-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.083827 May 19 21:51:21.597872 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 540/1090] 10.222.0.65 () {58 vars in 1154 bytes} [Thu May 19 21:51:21 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:52:13.373792 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 21:52:13.374472 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Thu May 19 21:52:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 19 21:52:23.638305 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 21:52:23.638957 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Thu May 19 21:52:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 19 21:52:26.863704 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 21:52:26.864279 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Thu May 19 21:52:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 19 21:52:51.392400 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:51.393478 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:52:51.586959 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-c21cd5ea-7ede-4015-8d3b-489bb294d367 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Action: 'create', calling method: .version_select at 0x7fe3682734c0>, body: {"keypair": {"name": "tempest-TestShelveInstance-2092241253", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH4BSBeD1q1L3TxW7LMjAw3TgEYLq81CGq+5Gm7G0XF6ZA2Ztp2MRc1Puw4INMWseukjLiXDSBgbfuSSRrOAl02xJFA1x/Z1Yhhr4sNneN6FE5lPSXq+YqVhpgieWolc1g=="}} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:52:51.610683 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.quota [None req-c21cd5ea-7ede-4015-8d3b-489bb294d367 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Getting quotas for project 52d49b95be55483f93b8a325d6bff693. Resources: {'key_pairs'} {{(pid=124350) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 21:52:51.617676 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.quota [None req-c21cd5ea-7ede-4015-8d3b-489bb294d367 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Getting quotas for user f69162209070421faef53c4f75803f38 and project 52d49b95be55483f93b8a325d6bff693. Resources: {'key_pairs'} {{(pid=124350) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 21:52:51.644215 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-c21cd5ea-7ede-4015-8d3b-489bb294d367 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.253518 May 19 21:52:51.644817 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 551/1091] 10.222.0.65 () {60 vars in 1158 bytes} [Thu May 19 21:52:51 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 21:53:12.145163 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_api:SELECT=20 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:12.146024 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_cell1:SELECT=41,nova_cell1:INSERT=1 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:12.150519 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-8a0fd3f6-4437-4769-afb4-358ede58b1dd tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1579961608", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-2092241253", "security_groups": [{"name": "tempest-secgroup-smoke-811819398"}], "networks": [{"uuid": "ca42bb01-6baf-420f-abc4-b878d5e93dad"}], "block_device_mapping_v2": [{"uuid": "5e98427f-46e3-4ba8-a7bb-2f319dfb5e7b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:53:12.384857 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.network.neutron [None req-8a0fd3f6-4437-4769-afb4-358ede58b1dd tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] validate_networks() for [('ca42bb01-6baf-420f-abc4-b878d5e93dad', None, None, None, None, None)] {{(pid=124349) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 19 21:53:12.914978 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.virt.hardware [None req-8a0fd3f6-4437-4769-afb4-358ede58b1dd tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Flavor limits 0:0:0 {{(pid=124349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 21:53:12.915431 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.virt.hardware [None req-8a0fd3f6-4437-4769-afb4-358ede58b1dd tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Image limits 0:0:0 {{(pid=124349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 21:53:12.915992 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.virt.hardware [None req-8a0fd3f6-4437-4769-afb4-358ede58b1dd tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Flavor pref 0:0:0 {{(pid=124349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 21:53:12.916435 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.virt.hardware [None req-8a0fd3f6-4437-4769-afb4-358ede58b1dd tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Image pref 0:0:0 {{(pid=124349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 21:53:12.916842 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.virt.hardware [None req-8a0fd3f6-4437-4769-afb4-358ede58b1dd tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124349) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 21:53:12.926379 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-8a0fd3f6-4437-4769-afb4-358ede58b1dd tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:53:12.926827 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-8a0fd3f6-4437-4769-afb4-358ede58b1dd tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:53:12.927662 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-8a0fd3f6-4437-4769-afb4-358ede58b1dd tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:53:12.928096 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-8a0fd3f6-4437-4769-afb4-358ede58b1dd tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:53:12.945096 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.quota [None req-8a0fd3f6-4437-4769-afb4-358ede58b1dd tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Getting quotas for project 52d49b95be55483f93b8a325d6bff693. Resources: {'ram', 'cores', 'instances'} {{(pid=124349) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 21:53:12.949868 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.quota [None req-8a0fd3f6-4437-4769-afb4-358ede58b1dd tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Getting quotas for user f69162209070421faef53c4f75803f38 and project 52d49b95be55483f93b8a325d6bff693. Resources: {'ram', 'cores', 'instances'} {{(pid=124349) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 21:53:13.021850 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-8a0fd3f6-4437-4769-afb4-358ede58b1dd tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Going to run 1 instances... {{(pid=124349) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 21:53:13.024816 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-8a0fd3f6-4437-4769-afb4-358ede58b1dd tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] [instance: d9e4b369-d1d9-4713-a8a4-27e41de2a89a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5e98427f-46e3-4ba8-a7bb-2f319dfb5e7b',volume_size=None,volume_type=None)] {{(pid=124349) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 21:53:13.162605 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-8a0fd3f6-4437-4769-afb4-358ede58b1dd tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.019241 May 19 21:53:13.163304 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 541/1092] 10.222.0.65 () {60 vars in 1146 bytes} [Thu May 19 21:53:12 2022] POST /compute/v2.1/servers => generated 405 bytes in 1021 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 21:53:13.171074 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell0:SELECT=4 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:13.173161 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:13.177673 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-dd676d6f-744d-4fc3-8dbc-f909da63475a tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:53:13.178308 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-dd676d6f-744d-4fc3-8dbc-f909da63475a tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] [instance: d9e4b369-d1d9-4713-a8a4-27e41de2a89a] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:53:13.291668 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-dd676d6f-744d-4fc3-8dbc-f909da63475a tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f69162209070421faef53c4f75803f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d49b95be55483f93b8a325d6bff693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:53:13.298875 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-dd676d6f-744d-4fc3-8dbc-f909da63475a tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] 10.222.0.65 "GET /compute/v2.1/servers/d9e4b369-d1d9-4713-a8a4-27e41de2a89a" status: 200 len: 1089 microversion: 2.1 time: 0.129161 May 19 21:53:13.299433 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 552/1093] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:53:13 2022] GET /compute/v2.1/servers/d9e4b369-d1d9-4713-a8a4-27e41de2a89a => generated 1089 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:53:14.316345 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-3b2934f6-52c3-4215-9089-f23bcff2a763 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:53:14.317302 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-3b2934f6-52c3-4215-9089-f23bcff2a763 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] [instance: d9e4b369-d1d9-4713-a8a4-27e41de2a89a] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:53:14.324259 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-3b2934f6-52c3-4215-9089-f23bcff2a763 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:53:14.324719 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-3b2934f6-52c3-4215-9089-f23bcff2a763 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:53:14.325911 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-3b2934f6-52c3-4215-9089-f23bcff2a763 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:53:14.325911 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-3b2934f6-52c3-4215-9089-f23bcff2a763 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:53:14.409906 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-3b2934f6-52c3-4215-9089-f23bcff2a763 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f69162209070421faef53c4f75803f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d49b95be55483f93b8a325d6bff693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:53:14.418170 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-3b2934f6-52c3-4215-9089-f23bcff2a763 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] 10.222.0.65 "GET /compute/v2.1/servers/d9e4b369-d1d9-4713-a8a4-27e41de2a89a" status: 200 len: 1205 microversion: 2.1 time: 0.105679 May 19 21:53:14.418820 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 542/1094] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:53:14 2022] GET /compute/v2.1/servers/d9e4b369-d1d9-4713-a8a4-27e41de2a89a => generated 1205 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:53:15.436715 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-07450af8-37b5-43c3-9958-d7b7e19a7a1e tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:53:15.437490 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-07450af8-37b5-43c3-9958-d7b7e19a7a1e tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] [instance: d9e4b369-d1d9-4713-a8a4-27e41de2a89a] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:53:15.445545 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-07450af8-37b5-43c3-9958-d7b7e19a7a1e tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:53:15.446107 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-07450af8-37b5-43c3-9958-d7b7e19a7a1e tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:53:15.446905 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-07450af8-37b5-43c3-9958-d7b7e19a7a1e tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:53:15.447572 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-07450af8-37b5-43c3-9958-d7b7e19a7a1e tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:53:15.600830 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-07450af8-37b5-43c3-9958-d7b7e19a7a1e tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f69162209070421faef53c4f75803f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d49b95be55483f93b8a325d6bff693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:53:15.609557 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-07450af8-37b5-43c3-9958-d7b7e19a7a1e tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] 10.222.0.65 "GET /compute/v2.1/servers/d9e4b369-d1d9-4713-a8a4-27e41de2a89a" status: 200 len: 1260 microversion: 2.1 time: 0.176694 May 19 21:53:15.610139 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 553/1095] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:53:15 2022] GET /compute/v2.1/servers/d9e4b369-d1d9-4713-a8a4-27e41de2a89a => generated 1260 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:53:15.693262 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [req-b1c08495-13dc-431d-94d7-2966f1f30527 req-168b941d-9c81-4b80-9def-9e272b0f4759 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9e4b369-d1d9-4713-a8a4-27e41de2a89a", "tag": "fb5785db-5a47-4d6c-a3a3-611049a4da85"}]} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:53:15.713672 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-b1c08495-13dc-431d-94d7-2966f1f30527 req-168b941d-9c81-4b80-9def-9e272b0f4759 service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:53:15.714417 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [req-b1c08495-13dc-431d-94d7-2966f1f30527 req-168b941d-9c81-4b80-9def-9e272b0f4759 service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:53:15.726279 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.compute.server_external_events [req-b1c08495-13dc-431d-94d7-2966f1f30527 req-168b941d-9c81-4b80-9def-9e272b0f4759 service nova] Creating event network-changed:fb5785db-5a47-4d6c-a3a3-611049a4da85 for instance d9e4b369-d1d9-4713-a8a4-27e41de2a89a on hv-cinder-83563 May 19 21:53:15.732218 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [req-b1c08495-13dc-431d-94d7-2966f1f30527 req-168b941d-9c81-4b80-9def-9e272b0f4759 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043067 May 19 21:53:15.737837 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 543/1096] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 21:53:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 21:53:16.627683 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-20be527d-b993-41dd-8227-38357c50ee0b tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:53:16.628334 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-20be527d-b993-41dd-8227-38357c50ee0b tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] [instance: d9e4b369-d1d9-4713-a8a4-27e41de2a89a] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:53:16.635643 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-20be527d-b993-41dd-8227-38357c50ee0b tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:53:16.636148 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-20be527d-b993-41dd-8227-38357c50ee0b tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:53:16.636934 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-20be527d-b993-41dd-8227-38357c50ee0b tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:53:16.637363 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-20be527d-b993-41dd-8227-38357c50ee0b tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:53:16.786836 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-20be527d-b993-41dd-8227-38357c50ee0b tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f69162209070421faef53c4f75803f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d49b95be55483f93b8a325d6bff693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:53:16.796455 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-20be527d-b993-41dd-8227-38357c50ee0b tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] 10.222.0.65 "GET /compute/v2.1/servers/d9e4b369-d1d9-4713-a8a4-27e41de2a89a" status: 200 len: 1260 microversion: 2.1 time: 0.172493 May 19 21:53:16.797185 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 554/1097] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:53:16 2022] GET /compute/v2.1/servers/d9e4b369-d1d9-4713-a8a4-27e41de2a89a => generated 1260 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 21:53:17.819078 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-ef4e63c7-32f4-4399-9277-991fe10521c2 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:53:17.819768 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-ef4e63c7-32f4-4399-9277-991fe10521c2 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] [instance: d9e4b369-d1d9-4713-a8a4-27e41de2a89a] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:53:17.827171 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ef4e63c7-32f4-4399-9277-991fe10521c2 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:53:17.831859 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ef4e63c7-32f4-4399-9277-991fe10521c2 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:53:17.832555 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ef4e63c7-32f4-4399-9277-991fe10521c2 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:53:17.833005 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ef4e63c7-32f4-4399-9277-991fe10521c2 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:53:17.994492 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-ef4e63c7-32f4-4399-9277-991fe10521c2 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f69162209070421faef53c4f75803f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d49b95be55483f93b8a325d6bff693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:53:18.002769 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-ef4e63c7-32f4-4399-9277-991fe10521c2 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] 10.222.0.65 "GET /compute/v2.1/servers/d9e4b369-d1d9-4713-a8a4-27e41de2a89a" status: 200 len: 1260 microversion: 2.1 time: 0.188520 May 19 21:53:18.003379 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 544/1098] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:53:17 2022] GET /compute/v2.1/servers/d9e4b369-d1d9-4713-a8a4-27e41de2a89a => generated 1260 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:53:19.021962 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-77082c4b-aba8-4a06-9d03-fcd6012e8171 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:53:19.022614 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-77082c4b-aba8-4a06-9d03-fcd6012e8171 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] [instance: d9e4b369-d1d9-4713-a8a4-27e41de2a89a] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:53:19.030655 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-77082c4b-aba8-4a06-9d03-fcd6012e8171 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:53:19.031088 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-77082c4b-aba8-4a06-9d03-fcd6012e8171 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:53:19.031835 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-77082c4b-aba8-4a06-9d03-fcd6012e8171 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:53:19.032256 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-77082c4b-aba8-4a06-9d03-fcd6012e8171 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:53:19.180433 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-77082c4b-aba8-4a06-9d03-fcd6012e8171 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f69162209070421faef53c4f75803f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d49b95be55483f93b8a325d6bff693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:53:19.188621 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-77082c4b-aba8-4a06-9d03-fcd6012e8171 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] 10.222.0.65 "GET /compute/v2.1/servers/d9e4b369-d1d9-4713-a8a4-27e41de2a89a" status: 200 len: 1260 microversion: 2.1 time: 0.172267 May 19 21:53:19.189191 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 555/1099] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:53:19 2022] GET /compute/v2.1/servers/d9e4b369-d1d9-4713-a8a4-27e41de2a89a => generated 1260 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:53:20.207150 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-24b7b893-2617-4b41-b13c-0e9430cd3a45 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:53:20.207732 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-24b7b893-2617-4b41-b13c-0e9430cd3a45 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] [instance: d9e4b369-d1d9-4713-a8a4-27e41de2a89a] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:53:20.215986 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-24b7b893-2617-4b41-b13c-0e9430cd3a45 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:53:20.216490 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-24b7b893-2617-4b41-b13c-0e9430cd3a45 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:53:20.217342 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-24b7b893-2617-4b41-b13c-0e9430cd3a45 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:53:20.217872 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-24b7b893-2617-4b41-b13c-0e9430cd3a45 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:53:20.383098 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-24b7b893-2617-4b41-b13c-0e9430cd3a45 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f69162209070421faef53c4f75803f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d49b95be55483f93b8a325d6bff693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:53:20.392701 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-24b7b893-2617-4b41-b13c-0e9430cd3a45 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] 10.222.0.65 "GET /compute/v2.1/servers/d9e4b369-d1d9-4713-a8a4-27e41de2a89a" status: 200 len: 1260 microversion: 2.1 time: 0.190705 May 19 21:53:20.393431 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 545/1100] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:53:20 2022] GET /compute/v2.1/servers/d9e4b369-d1d9-4713-a8a4-27e41de2a89a => generated 1260 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:53:21.415393 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-c6418eed-aae7-4c55-b398-0d3629cfa66a tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:53:21.416291 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-c6418eed-aae7-4c55-b398-0d3629cfa66a tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] [instance: d9e4b369-d1d9-4713-a8a4-27e41de2a89a] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:53:21.426766 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c6418eed-aae7-4c55-b398-0d3629cfa66a tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:53:21.427460 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c6418eed-aae7-4c55-b398-0d3629cfa66a tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:53:21.428604 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c6418eed-aae7-4c55-b398-0d3629cfa66a tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:53:21.429245 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c6418eed-aae7-4c55-b398-0d3629cfa66a tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:53:21.577381 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-c6418eed-aae7-4c55-b398-0d3629cfa66a tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f69162209070421faef53c4f75803f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d49b95be55483f93b8a325d6bff693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:53:21.585578 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-c6418eed-aae7-4c55-b398-0d3629cfa66a tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] 10.222.0.65 "GET /compute/v2.1/servers/d9e4b369-d1d9-4713-a8a4-27e41de2a89a" status: 200 len: 1260 microversion: 2.1 time: 0.176899 May 19 21:53:21.586151 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 556/1101] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:53:21 2022] GET /compute/v2.1/servers/d9e4b369-d1d9-4713-a8a4-27e41de2a89a => generated 1260 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:53:22.606351 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-cf40a73f-2f70-4511-8a3e-81925a98937a tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:53:22.606988 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-cf40a73f-2f70-4511-8a3e-81925a98937a tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] [instance: d9e4b369-d1d9-4713-a8a4-27e41de2a89a] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:53:22.614003 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-cf40a73f-2f70-4511-8a3e-81925a98937a tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:53:22.614484 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-cf40a73f-2f70-4511-8a3e-81925a98937a tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:53:22.615251 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-cf40a73f-2f70-4511-8a3e-81925a98937a tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:53:22.615654 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-cf40a73f-2f70-4511-8a3e-81925a98937a tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:53:22.935643 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_cell0:SELECT=2 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:22.957356 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_cell0:SELECT=6 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:23.038097 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-cf40a73f-2f70-4511-8a3e-81925a98937a tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f69162209070421faef53c4f75803f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d49b95be55483f93b8a325d6bff693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:53:23.046330 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-cf40a73f-2f70-4511-8a3e-81925a98937a tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] 10.222.0.65 "GET /compute/v2.1/servers/d9e4b369-d1d9-4713-a8a4-27e41de2a89a" status: 200 len: 1260 microversion: 2.1 time: 0.445742 May 19 21:53:23.046916 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 546/1102] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:53:22 2022] GET /compute/v2.1/servers/d9e4b369-d1d9-4713-a8a4-27e41de2a89a => generated 1260 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:53:24.066714 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-1eca4699-8ce7-4bb8-a4bd-de779b2214f4 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:53:24.067573 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-1eca4699-8ce7-4bb8-a4bd-de779b2214f4 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] [instance: d9e4b369-d1d9-4713-a8a4-27e41de2a89a] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:53:24.072445 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell0:SELECT=2 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:53:24.077308 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1eca4699-8ce7-4bb8-a4bd-de779b2214f4 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:53:24.077750 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1eca4699-8ce7-4bb8-a4bd-de779b2214f4 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:53:24.078572 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1eca4699-8ce7-4bb8-a4bd-de779b2214f4 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:53:24.079000 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-1eca4699-8ce7-4bb8-a4bd-de779b2214f4 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:53:24.219300 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-1eca4699-8ce7-4bb8-a4bd-de779b2214f4 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f69162209070421faef53c4f75803f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d49b95be55483f93b8a325d6bff693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:53:24.227182 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-1eca4699-8ce7-4bb8-a4bd-de779b2214f4 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] 10.222.0.65 "GET /compute/v2.1/servers/d9e4b369-d1d9-4713-a8a4-27e41de2a89a" status: 200 len: 1260 microversion: 2.1 time: 0.167082 May 19 21:53:24.227751 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 557/1103] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:53:24 2022] GET /compute/v2.1/servers/d9e4b369-d1d9-4713-a8a4-27e41de2a89a => generated 1260 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:53:25.246477 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-6d3b0818-bda0-4caf-aae0-91785614cfdf tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:53:25.247088 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-6d3b0818-bda0-4caf-aae0-91785614cfdf tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] [instance: d9e4b369-d1d9-4713-a8a4-27e41de2a89a] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:53:25.254193 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-6d3b0818-bda0-4caf-aae0-91785614cfdf tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:53:25.254666 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-6d3b0818-bda0-4caf-aae0-91785614cfdf tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:53:25.255416 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-6d3b0818-bda0-4caf-aae0-91785614cfdf tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:53:25.255852 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-6d3b0818-bda0-4caf-aae0-91785614cfdf tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:53:25.403456 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-6d3b0818-bda0-4caf-aae0-91785614cfdf tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f69162209070421faef53c4f75803f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d49b95be55483f93b8a325d6bff693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:53:25.412208 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-6d3b0818-bda0-4caf-aae0-91785614cfdf tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] 10.222.0.65 "GET /compute/v2.1/servers/d9e4b369-d1d9-4713-a8a4-27e41de2a89a" status: 200 len: 1260 microversion: 2.1 time: 0.169771 May 19 21:53:25.412802 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 547/1104] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:53:25 2022] GET /compute/v2.1/servers/d9e4b369-d1d9-4713-a8a4-27e41de2a89a => generated 1260 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:53:25.461093 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [req-a608d3dd-3718-401e-a9ec-dab97541b5fa req-6644270d-ca1f-4a93-8015-09594c54786b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9e4b369-d1d9-4713-a8a4-27e41de2a89a", "name": "network-vif-plugged", "status": "completed", "tag": "fb5785db-5a47-4d6c-a3a3-611049a4da85"}]} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:53:25.473916 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-a608d3dd-3718-401e-a9ec-dab97541b5fa req-6644270d-ca1f-4a93-8015-09594c54786b service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:53:25.473916 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-a608d3dd-3718-401e-a9ec-dab97541b5fa req-6644270d-ca1f-4a93-8015-09594c54786b service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:53:25.482880 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.compute.server_external_events [req-a608d3dd-3718-401e-a9ec-dab97541b5fa req-6644270d-ca1f-4a93-8015-09594c54786b service nova] Creating event network-vif-plugged:fb5785db-5a47-4d6c-a3a3-611049a4da85 for instance d9e4b369-d1d9-4713-a8a4-27e41de2a89a on hv-cinder-83563 May 19 21:53:25.488154 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [req-a608d3dd-3718-401e-a9ec-dab97541b5fa req-6644270d-ca1f-4a93-8015-09594c54786b service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030765 May 19 21:53:25.489003 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 558/1105] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 21:53:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 21:53:26.433419 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-bb115c91-ce4d-4e98-8e91-68f6e97f6c13 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:53:26.434071 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-bb115c91-ce4d-4e98-8e91-68f6e97f6c13 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] [instance: d9e4b369-d1d9-4713-a8a4-27e41de2a89a] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:53:26.443403 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-bb115c91-ce4d-4e98-8e91-68f6e97f6c13 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:53:26.443950 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-bb115c91-ce4d-4e98-8e91-68f6e97f6c13 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:53:26.444897 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-bb115c91-ce4d-4e98-8e91-68f6e97f6c13 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:53:26.445501 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-bb115c91-ce4d-4e98-8e91-68f6e97f6c13 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:53:26.585437 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-bb115c91-ce4d-4e98-8e91-68f6e97f6c13 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f69162209070421faef53c4f75803f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d49b95be55483f93b8a325d6bff693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:53:26.595902 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-bb115c91-ce4d-4e98-8e91-68f6e97f6c13 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] 10.222.0.65 "GET /compute/v2.1/servers/d9e4b369-d1d9-4713-a8a4-27e41de2a89a" status: 200 len: 1260 microversion: 2.1 time: 0.168338 May 19 21:53:26.596486 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 548/1106] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:53:26 2022] GET /compute/v2.1/servers/d9e4b369-d1d9-4713-a8a4-27e41de2a89a => generated 1260 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:53:27.615118 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-0392ce9e-ddde-48da-a27b-ad709689b430 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:53:27.615810 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-0392ce9e-ddde-48da-a27b-ad709689b430 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] [instance: d9e4b369-d1d9-4713-a8a4-27e41de2a89a] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:53:27.623335 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0392ce9e-ddde-48da-a27b-ad709689b430 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:53:27.623782 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0392ce9e-ddde-48da-a27b-ad709689b430 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:53:27.624581 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0392ce9e-ddde-48da-a27b-ad709689b430 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:53:27.624985 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-0392ce9e-ddde-48da-a27b-ad709689b430 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:53:27.780524 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-0392ce9e-ddde-48da-a27b-ad709689b430 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f69162209070421faef53c4f75803f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d49b95be55483f93b8a325d6bff693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:53:27.788719 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-0392ce9e-ddde-48da-a27b-ad709689b430 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] 10.222.0.65 "GET /compute/v2.1/servers/d9e4b369-d1d9-4713-a8a4-27e41de2a89a" status: 200 len: 1443 microversion: 2.1 time: 0.178490 May 19 21:53:27.789289 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 559/1107] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:53:27 2022] GET /compute/v2.1/servers/d9e4b369-d1d9-4713-a8a4-27e41de2a89a => generated 1443 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:53:27.807960 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-05b85bab-2034-4b34-981f-1cb2293f3e97 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:53:27.808781 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-05b85bab-2034-4b34-981f-1cb2293f3e97 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] [instance: d9e4b369-d1d9-4713-a8a4-27e41de2a89a] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:53:27.818999 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-05b85bab-2034-4b34-981f-1cb2293f3e97 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:53:27.819621 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-05b85bab-2034-4b34-981f-1cb2293f3e97 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:53:27.820847 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-05b85bab-2034-4b34-981f-1cb2293f3e97 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:53:27.821524 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-05b85bab-2034-4b34-981f-1cb2293f3e97 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:53:27.959041 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-05b85bab-2034-4b34-981f-1cb2293f3e97 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f69162209070421faef53c4f75803f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d49b95be55483f93b8a325d6bff693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:53:27.970636 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-05b85bab-2034-4b34-981f-1cb2293f3e97 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] 10.222.0.65 "GET /compute/v2.1/servers/d9e4b369-d1d9-4713-a8a4-27e41de2a89a" status: 200 len: 1443 microversion: 2.1 time: 0.168806 May 19 21:53:27.971502 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 549/1108] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:53:27 2022] GET /compute/v2.1/servers/d9e4b369-d1d9-4713-a8a4-27e41de2a89a => generated 1443 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:53:29.744232 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [req-6c5be615-2944-45ad-93ae-de4e011fdce3 req-126b0ab1-0951-476e-a16e-46a7ae0ddc61 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9e4b369-d1d9-4713-a8a4-27e41de2a89a", "tag": "fb5785db-5a47-4d6c-a3a3-611049a4da85"}]} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:53:29.753027 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-6c5be615-2944-45ad-93ae-de4e011fdce3 req-126b0ab1-0951-476e-a16e-46a7ae0ddc61 service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:53:29.753463 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-6c5be615-2944-45ad-93ae-de4e011fdce3 req-126b0ab1-0951-476e-a16e-46a7ae0ddc61 service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:53:29.764961 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.compute.server_external_events [req-6c5be615-2944-45ad-93ae-de4e011fdce3 req-126b0ab1-0951-476e-a16e-46a7ae0ddc61 service nova] Creating event network-changed:fb5785db-5a47-4d6c-a3a3-611049a4da85 for instance d9e4b369-d1d9-4713-a8a4-27e41de2a89a on hv-cinder-83563 May 19 21:53:29.770279 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [req-6c5be615-2944-45ad-93ae-de4e011fdce3 req-126b0ab1-0951-476e-a16e-46a7ae0ddc61 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029735 May 19 21:53:29.771229 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 560/1109] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 21:53:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 21:55:33.384512 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 21:55:33.385827 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Thu May 19 21:55:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 19 21:55:43.649750 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 21:55:43.650990 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Thu May 19 21:55:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 19 21:55:44.936193 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:55:44.937801 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_cell1:SELECT=46 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:55:44.945202 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-cd655dde-fa60-4a9c-a72a-902129406f5c tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:55:44.946099 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-cd655dde-fa60-4a9c-a72a-902129406f5c tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] [instance: d9e4b369-d1d9-4713-a8a4-27e41de2a89a] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:55:44.956565 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-cd655dde-fa60-4a9c-a72a-902129406f5c tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:55:44.957372 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-cd655dde-fa60-4a9c-a72a-902129406f5c tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:55:44.958151 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-cd655dde-fa60-4a9c-a72a-902129406f5c tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:55:44.958621 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-cd655dde-fa60-4a9c-a72a-902129406f5c tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:55:44.983185 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.objects.instance [None req-cd655dde-fa60-4a9c-a72a-902129406f5c tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lazy-loading 'flavor' on Instance uuid d9e4b369-d1d9-4713-a8a4-27e41de2a89a {{(pid=124349) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 21:55:45.061454 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-cd655dde-fa60-4a9c-a72a-902129406f5c tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] 10.222.0.65 "POST /compute/v2.1/servers/d9e4b369-d1d9-4713-a8a4-27e41de2a89a/action" status: 202 len: 0 microversion: 2.1 time: 0.128726 May 19 21:55:45.062029 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 550/1110] 10.222.0.65 () {60 vars in 1277 bytes} [Thu May 19 21:55:44 2022] POST /compute/v2.1/servers/d9e4b369-d1d9-4713-a8a4-27e41de2a89a/action => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 21:55:45.068654 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b43f4952-b096-4d60-aff4-2a9fad682ce9] AMQP server on 10.222.0.65:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 19 21:55:45.069862 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_api:SELECT=20 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:55:45.070604 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell1:SELECT=40 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:55:45.075277 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-e1f12c07-ea91-4146-98d9-c615c4a02671 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:55:45.075964 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-e1f12c07-ea91-4146-98d9-c615c4a02671 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] [instance: d9e4b369-d1d9-4713-a8a4-27e41de2a89a] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:55:45.083623 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e1f12c07-ea91-4146-98d9-c615c4a02671 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:55:45.084064 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e1f12c07-ea91-4146-98d9-c615c4a02671 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:55:45.084817 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e1f12c07-ea91-4146-98d9-c615c4a02671 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:55:45.085245 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-e1f12c07-ea91-4146-98d9-c615c4a02671 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:55:45.226216 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-e1f12c07-ea91-4146-98d9-c615c4a02671 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f69162209070421faef53c4f75803f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d49b95be55483f93b8a325d6bff693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:55:45.237385 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-e1f12c07-ea91-4146-98d9-c615c4a02671 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] 10.222.0.65 "GET /compute/v2.1/servers/d9e4b369-d1d9-4713-a8a4-27e41de2a89a" status: 200 len: 1568 microversion: 2.1 time: 0.170523 May 19 21:55:45.238222 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 561/1111] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:55:45 2022] GET /compute/v2.1/servers/d9e4b369-d1d9-4713-a8a4-27e41de2a89a => generated 1568 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:55:46.261301 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-29c236d5-8d07-4fcd-bfb6-c7d18a92ab0a tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:55:46.262517 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-29c236d5-8d07-4fcd-bfb6-c7d18a92ab0a tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] [instance: d9e4b369-d1d9-4713-a8a4-27e41de2a89a] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:55:46.270112 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-29c236d5-8d07-4fcd-bfb6-c7d18a92ab0a tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:55:46.270584 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-29c236d5-8d07-4fcd-bfb6-c7d18a92ab0a tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:55:46.271345 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-29c236d5-8d07-4fcd-bfb6-c7d18a92ab0a tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:55:46.271778 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-29c236d5-8d07-4fcd-bfb6-c7d18a92ab0a tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:55:46.410744 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-29c236d5-8d07-4fcd-bfb6-c7d18a92ab0a tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f69162209070421faef53c4f75803f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d49b95be55483f93b8a325d6bff693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:55:46.418940 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-29c236d5-8d07-4fcd-bfb6-c7d18a92ab0a tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] 10.222.0.65 "GET /compute/v2.1/servers/d9e4b369-d1d9-4713-a8a4-27e41de2a89a" status: 200 len: 1568 microversion: 2.1 time: 0.165694 May 19 21:55:46.419514 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 551/1112] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:55:46 2022] GET /compute/v2.1/servers/d9e4b369-d1d9-4713-a8a4-27e41de2a89a => generated 1568 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:55:46.873626 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 21:55:46.873796 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Thu May 19 21:55:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 19 21:55:47.445623 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-aab98680-976f-48d0-9671-ff1ba96696db tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:55:47.446653 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-aab98680-976f-48d0-9671-ff1ba96696db tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] [instance: d9e4b369-d1d9-4713-a8a4-27e41de2a89a] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:55:47.460611 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-aab98680-976f-48d0-9671-ff1ba96696db tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:55:47.461350 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-aab98680-976f-48d0-9671-ff1ba96696db tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:55:47.462661 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-aab98680-976f-48d0-9671-ff1ba96696db tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:55:47.463541 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-aab98680-976f-48d0-9671-ff1ba96696db tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:55:47.470459 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO oslo.messaging._drivers.impl_rabbit [-] [b43f4952-b096-4d60-aff4-2a9fad682ce9] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 41306. May 19 21:55:47.599970 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-aab98680-976f-48d0-9671-ff1ba96696db tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f69162209070421faef53c4f75803f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d49b95be55483f93b8a325d6bff693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:55:47.608293 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-aab98680-976f-48d0-9671-ff1ba96696db tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] 10.222.0.65 "GET /compute/v2.1/servers/d9e4b369-d1d9-4713-a8a4-27e41de2a89a" status: 200 len: 1568 microversion: 2.1 time: 0.169273 May 19 21:55:47.608873 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 562/1113] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:55:47 2022] GET /compute/v2.1/servers/d9e4b369-d1d9-4713-a8a4-27e41de2a89a => generated 1568 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:55:48.630028 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-0b1d4ddc-79cd-4e7d-aaf0-8627df804c39 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:55:48.631068 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-0b1d4ddc-79cd-4e7d-aaf0-8627df804c39 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] [instance: d9e4b369-d1d9-4713-a8a4-27e41de2a89a] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:55:48.640559 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-0b1d4ddc-79cd-4e7d-aaf0-8627df804c39 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:55:48.641019 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-0b1d4ddc-79cd-4e7d-aaf0-8627df804c39 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:55:48.641788 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-0b1d4ddc-79cd-4e7d-aaf0-8627df804c39 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:55:48.642217 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-0b1d4ddc-79cd-4e7d-aaf0-8627df804c39 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:55:48.790298 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-0b1d4ddc-79cd-4e7d-aaf0-8627df804c39 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f69162209070421faef53c4f75803f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d49b95be55483f93b8a325d6bff693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:55:48.801895 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-0b1d4ddc-79cd-4e7d-aaf0-8627df804c39 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] 10.222.0.65 "GET /compute/v2.1/servers/d9e4b369-d1d9-4713-a8a4-27e41de2a89a" status: 200 len: 1568 microversion: 2.1 time: 0.178495 May 19 21:55:48.802691 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 552/1114] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:55:48 2022] GET /compute/v2.1/servers/d9e4b369-d1d9-4713-a8a4-27e41de2a89a => generated 1568 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:55:49.279640 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 21:55:49.280386 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Thu May 19 21:55:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 19 21:55:49.823735 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-2bce76cc-97ef-40e0-92fe-9e0fd5c4d830 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:55:49.824715 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-2bce76cc-97ef-40e0-92fe-9e0fd5c4d830 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] [instance: d9e4b369-d1d9-4713-a8a4-27e41de2a89a] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:55:49.836658 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2bce76cc-97ef-40e0-92fe-9e0fd5c4d830 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:55:49.837388 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2bce76cc-97ef-40e0-92fe-9e0fd5c4d830 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:55:49.838668 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2bce76cc-97ef-40e0-92fe-9e0fd5c4d830 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:55:49.839384 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-2bce76cc-97ef-40e0-92fe-9e0fd5c4d830 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:55:49.977249 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-2bce76cc-97ef-40e0-92fe-9e0fd5c4d830 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f69162209070421faef53c4f75803f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d49b95be55483f93b8a325d6bff693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:55:49.985694 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-2bce76cc-97ef-40e0-92fe-9e0fd5c4d830 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] 10.222.0.65 "GET /compute/v2.1/servers/d9e4b369-d1d9-4713-a8a4-27e41de2a89a" status: 200 len: 1568 microversion: 2.1 time: 0.168555 May 19 21:55:49.986276 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 563/1115] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:55:49 2022] GET /compute/v2.1/servers/d9e4b369-d1d9-4713-a8a4-27e41de2a89a => generated 1568 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:55:51.007446 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-53f44630-dfbb-4792-aaeb-0aca9209e1e2 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:55:51.008444 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-53f44630-dfbb-4792-aaeb-0aca9209e1e2 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] [instance: d9e4b369-d1d9-4713-a8a4-27e41de2a89a] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:55:51.019808 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-53f44630-dfbb-4792-aaeb-0aca9209e1e2 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:55:51.020554 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-53f44630-dfbb-4792-aaeb-0aca9209e1e2 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:55:51.021818 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-53f44630-dfbb-4792-aaeb-0aca9209e1e2 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:55:51.022593 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-53f44630-dfbb-4792-aaeb-0aca9209e1e2 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:55:51.163089 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-53f44630-dfbb-4792-aaeb-0aca9209e1e2 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f69162209070421faef53c4f75803f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d49b95be55483f93b8a325d6bff693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:55:51.175327 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-53f44630-dfbb-4792-aaeb-0aca9209e1e2 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] 10.222.0.65 "GET /compute/v2.1/servers/d9e4b369-d1d9-4713-a8a4-27e41de2a89a" status: 200 len: 1568 microversion: 2.1 time: 0.174196 May 19 21:55:51.176094 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 553/1116] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:55:50 2022] GET /compute/v2.1/servers/d9e4b369-d1d9-4713-a8a4-27e41de2a89a => generated 1568 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:55:52.193140 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-4d82a4b3-7ac9-4a6b-bf14-bb42dbbf1e09 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:55:52.193764 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-4d82a4b3-7ac9-4a6b-bf14-bb42dbbf1e09 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] [instance: d9e4b369-d1d9-4713-a8a4-27e41de2a89a] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:55:52.200370 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4d82a4b3-7ac9-4a6b-bf14-bb42dbbf1e09 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:55:52.200810 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4d82a4b3-7ac9-4a6b-bf14-bb42dbbf1e09 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:55:52.201886 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4d82a4b3-7ac9-4a6b-bf14-bb42dbbf1e09 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:55:52.202349 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-4d82a4b3-7ac9-4a6b-bf14-bb42dbbf1e09 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:55:52.337721 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-4d82a4b3-7ac9-4a6b-bf14-bb42dbbf1e09 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f69162209070421faef53c4f75803f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d49b95be55483f93b8a325d6bff693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:55:52.349554 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-4d82a4b3-7ac9-4a6b-bf14-bb42dbbf1e09 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] 10.222.0.65 "GET /compute/v2.1/servers/d9e4b369-d1d9-4713-a8a4-27e41de2a89a" status: 200 len: 1568 microversion: 2.1 time: 0.160132 May 19 21:55:52.350456 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 564/1117] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:55:52 2022] GET /compute/v2.1/servers/d9e4b369-d1d9-4713-a8a4-27e41de2a89a => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:55:53.373185 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-397b8dbc-0eec-4d2e-bf69-d82d95ebab7a tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:55:53.373889 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-397b8dbc-0eec-4d2e-bf69-d82d95ebab7a tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] [instance: d9e4b369-d1d9-4713-a8a4-27e41de2a89a] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:55:53.381908 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-397b8dbc-0eec-4d2e-bf69-d82d95ebab7a tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:55:53.382482 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-397b8dbc-0eec-4d2e-bf69-d82d95ebab7a tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:55:53.383377 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-397b8dbc-0eec-4d2e-bf69-d82d95ebab7a tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:55:53.383885 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-397b8dbc-0eec-4d2e-bf69-d82d95ebab7a tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:55:53.535261 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-397b8dbc-0eec-4d2e-bf69-d82d95ebab7a tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f69162209070421faef53c4f75803f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d49b95be55483f93b8a325d6bff693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:55:53.543388 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-397b8dbc-0eec-4d2e-bf69-d82d95ebab7a tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] 10.222.0.65 "GET /compute/v2.1/servers/d9e4b369-d1d9-4713-a8a4-27e41de2a89a" status: 200 len: 1568 microversion: 2.1 time: 0.176920 May 19 21:55:53.543947 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 554/1118] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:55:53 2022] GET /compute/v2.1/servers/d9e4b369-d1d9-4713-a8a4-27e41de2a89a => generated 1568 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:55:54.561960 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-089c0368-5521-46a6-aaeb-c233d50319c3 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:55:54.562590 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-089c0368-5521-46a6-aaeb-c233d50319c3 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] [instance: d9e4b369-d1d9-4713-a8a4-27e41de2a89a] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:55:54.571786 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-089c0368-5521-46a6-aaeb-c233d50319c3 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:55:54.572455 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-089c0368-5521-46a6-aaeb-c233d50319c3 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:55:54.573680 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-089c0368-5521-46a6-aaeb-c233d50319c3 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:55:54.574416 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-089c0368-5521-46a6-aaeb-c233d50319c3 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:55:54.714534 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-089c0368-5521-46a6-aaeb-c233d50319c3 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f69162209070421faef53c4f75803f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d49b95be55483f93b8a325d6bff693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:55:54.725853 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-089c0368-5521-46a6-aaeb-c233d50319c3 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] 10.222.0.65 "GET /compute/v2.1/servers/d9e4b369-d1d9-4713-a8a4-27e41de2a89a" status: 200 len: 1568 microversion: 2.1 time: 0.167871 May 19 21:55:54.726643 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 565/1119] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:55:54 2022] GET /compute/v2.1/servers/d9e4b369-d1d9-4713-a8a4-27e41de2a89a => generated 1568 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:55:55.746049 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-ad326e0a-8483-4b07-a72a-207d70380bb9 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:55:55.746726 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-ad326e0a-8483-4b07-a72a-207d70380bb9 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] [instance: d9e4b369-d1d9-4713-a8a4-27e41de2a89a] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:55:55.753838 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ad326e0a-8483-4b07-a72a-207d70380bb9 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:55:55.754294 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ad326e0a-8483-4b07-a72a-207d70380bb9 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:55:55.755098 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ad326e0a-8483-4b07-a72a-207d70380bb9 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:55:55.755533 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-ad326e0a-8483-4b07-a72a-207d70380bb9 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:55:55.891209 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-ad326e0a-8483-4b07-a72a-207d70380bb9 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f69162209070421faef53c4f75803f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d49b95be55483f93b8a325d6bff693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:55:55.898939 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-ad326e0a-8483-4b07-a72a-207d70380bb9 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] 10.222.0.65 "GET /compute/v2.1/servers/d9e4b369-d1d9-4713-a8a4-27e41de2a89a" status: 200 len: 1568 microversion: 2.1 time: 0.157003 May 19 21:55:55.899527 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 555/1120] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:55:55 2022] GET /compute/v2.1/servers/d9e4b369-d1d9-4713-a8a4-27e41de2a89a => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:55:56.781644 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 21:55:56.782622 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Thu May 19 21:55:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 19 21:55:56.919597 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-c82ce4fd-9799-48e0-ba2b-f8f2f4222d53 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:55:56.920516 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-c82ce4fd-9799-48e0-ba2b-f8f2f4222d53 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] [instance: d9e4b369-d1d9-4713-a8a4-27e41de2a89a] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:55:56.927674 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c82ce4fd-9799-48e0-ba2b-f8f2f4222d53 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:55:56.928119 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c82ce4fd-9799-48e0-ba2b-f8f2f4222d53 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:55:56.928881 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c82ce4fd-9799-48e0-ba2b-f8f2f4222d53 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:55:56.929307 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-c82ce4fd-9799-48e0-ba2b-f8f2f4222d53 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:55:57.067438 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-c82ce4fd-9799-48e0-ba2b-f8f2f4222d53 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f69162209070421faef53c4f75803f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d49b95be55483f93b8a325d6bff693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:55:57.075100 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-c82ce4fd-9799-48e0-ba2b-f8f2f4222d53 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] 10.222.0.65 "GET /compute/v2.1/servers/d9e4b369-d1d9-4713-a8a4-27e41de2a89a" status: 200 len: 1568 microversion: 2.1 time: 0.160601 May 19 21:55:57.075639 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 566/1121] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:55:56 2022] GET /compute/v2.1/servers/d9e4b369-d1d9-4713-a8a4-27e41de2a89a => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:55:58.092975 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-a4cdd0c4-e04b-44bf-8b70-19107af59ca0 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:55:58.093555 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-a4cdd0c4-e04b-44bf-8b70-19107af59ca0 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] [instance: d9e4b369-d1d9-4713-a8a4-27e41de2a89a] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:55:58.100595 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a4cdd0c4-e04b-44bf-8b70-19107af59ca0 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:55:58.101042 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a4cdd0c4-e04b-44bf-8b70-19107af59ca0 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:55:58.101802 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a4cdd0c4-e04b-44bf-8b70-19107af59ca0 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:55:58.102253 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-a4cdd0c4-e04b-44bf-8b70-19107af59ca0 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:55:58.238408 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-a4cdd0c4-e04b-44bf-8b70-19107af59ca0 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f69162209070421faef53c4f75803f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d49b95be55483f93b8a325d6bff693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:55:58.246046 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-a4cdd0c4-e04b-44bf-8b70-19107af59ca0 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] 10.222.0.65 "GET /compute/v2.1/servers/d9e4b369-d1d9-4713-a8a4-27e41de2a89a" status: 200 len: 1509 microversion: 2.1 time: 0.157026 May 19 21:55:58.246648 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 556/1122] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:55:58 2022] GET /compute/v2.1/servers/d9e4b369-d1d9-4713-a8a4-27e41de2a89a => generated 1509 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:55:58.263465 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-3f8cde5d-7924-417f-b298-12efb339bdab tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:55:58.264000 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-3f8cde5d-7924-417f-b298-12efb339bdab tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] [instance: d9e4b369-d1d9-4713-a8a4-27e41de2a89a] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:55:58.271324 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3f8cde5d-7924-417f-b298-12efb339bdab tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:55:58.271763 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3f8cde5d-7924-417f-b298-12efb339bdab tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:55:58.272511 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3f8cde5d-7924-417f-b298-12efb339bdab tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:55:58.272933 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-3f8cde5d-7924-417f-b298-12efb339bdab tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:55:58.464293 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-3f8cde5d-7924-417f-b298-12efb339bdab tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] 10.222.0.65 "POST /compute/v2.1/servers/d9e4b369-d1d9-4713-a8a4-27e41de2a89a/action" status: 202 len: 0 microversion: 2.1 time: 0.204373 May 19 21:55:58.464985 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 567/1123] 10.222.0.65 () {60 vars in 1277 bytes} [Thu May 19 21:55:58 2022] POST /compute/v2.1/servers/d9e4b369-d1d9-4713-a8a4-27e41de2a89a/action => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 19 21:55:58.475295 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-b41d29fe-a9b1-4cc1-a268-838c95701c18 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:55:58.476238 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-b41d29fe-a9b1-4cc1-a268-838c95701c18 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] [instance: d9e4b369-d1d9-4713-a8a4-27e41de2a89a] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:55:58.482420 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-b41d29fe-a9b1-4cc1-a268-838c95701c18 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:55:58.482861 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-b41d29fe-a9b1-4cc1-a268-838c95701c18 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:55:58.483619 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-b41d29fe-a9b1-4cc1-a268-838c95701c18 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:55:58.484045 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-b41d29fe-a9b1-4cc1-a268-838c95701c18 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:55:58.618583 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-b41d29fe-a9b1-4cc1-a268-838c95701c18 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f69162209070421faef53c4f75803f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d49b95be55483f93b8a325d6bff693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:55:58.626177 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-b41d29fe-a9b1-4cc1-a268-838c95701c18 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] 10.222.0.65 "GET /compute/v2.1/servers/d9e4b369-d1d9-4713-a8a4-27e41de2a89a" status: 200 len: 1517 microversion: 2.1 time: 0.155049 May 19 21:55:58.626828 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 557/1124] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:55:58 2022] GET /compute/v2.1/servers/d9e4b369-d1d9-4713-a8a4-27e41de2a89a => generated 1517 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:55:59.644253 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-f04bb6c5-d5d3-461f-a960-2dcd38ac3851 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:55:59.645046 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-f04bb6c5-d5d3-461f-a960-2dcd38ac3851 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] [instance: d9e4b369-d1d9-4713-a8a4-27e41de2a89a] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:55:59.651341 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f04bb6c5-d5d3-461f-a960-2dcd38ac3851 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:55:59.651792 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f04bb6c5-d5d3-461f-a960-2dcd38ac3851 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:55:59.652558 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f04bb6c5-d5d3-461f-a960-2dcd38ac3851 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:55:59.652994 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f04bb6c5-d5d3-461f-a960-2dcd38ac3851 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:55:59.789111 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-f04bb6c5-d5d3-461f-a960-2dcd38ac3851 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f69162209070421faef53c4f75803f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d49b95be55483f93b8a325d6bff693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:55:59.797076 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-f04bb6c5-d5d3-461f-a960-2dcd38ac3851 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] 10.222.0.65 "GET /compute/v2.1/servers/d9e4b369-d1d9-4713-a8a4-27e41de2a89a" status: 200 len: 1519 microversion: 2.1 time: 0.157490 May 19 21:55:59.797958 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 568/1125] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:55:59 2022] GET /compute/v2.1/servers/d9e4b369-d1d9-4713-a8a4-27e41de2a89a => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:56:00.819368 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-46554963-21e3-4910-87f4-fd04f15b9321 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:56:00.820343 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-46554963-21e3-4910-87f4-fd04f15b9321 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] [instance: d9e4b369-d1d9-4713-a8a4-27e41de2a89a] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:56:00.831529 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-46554963-21e3-4910-87f4-fd04f15b9321 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:56:00.832656 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-46554963-21e3-4910-87f4-fd04f15b9321 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:56:00.833902 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-46554963-21e3-4910-87f4-fd04f15b9321 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:56:00.834662 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-46554963-21e3-4910-87f4-fd04f15b9321 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:56:00.984576 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-46554963-21e3-4910-87f4-fd04f15b9321 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f69162209070421faef53c4f75803f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d49b95be55483f93b8a325d6bff693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:56:00.992649 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-46554963-21e3-4910-87f4-fd04f15b9321 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] 10.222.0.65 "GET /compute/v2.1/servers/d9e4b369-d1d9-4713-a8a4-27e41de2a89a" status: 200 len: 1575 microversion: 2.1 time: 0.179935 May 19 21:56:00.993222 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 558/1126] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:56:00 2022] GET /compute/v2.1/servers/d9e4b369-d1d9-4713-a8a4-27e41de2a89a => generated 1575 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:56:02.009582 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-1cf7ef99-24b2-47d3-8779-cfc72b9d00c7 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:56:02.011205 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-1cf7ef99-24b2-47d3-8779-cfc72b9d00c7 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] [instance: d9e4b369-d1d9-4713-a8a4-27e41de2a89a] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:56:02.018617 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1cf7ef99-24b2-47d3-8779-cfc72b9d00c7 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:56:02.019073 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1cf7ef99-24b2-47d3-8779-cfc72b9d00c7 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:56:02.019875 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1cf7ef99-24b2-47d3-8779-cfc72b9d00c7 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:56:02.020309 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-1cf7ef99-24b2-47d3-8779-cfc72b9d00c7 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:56:02.030279 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [req-2b193d39-a130-46d9-baec-a4239f78ec2c req-c12d843b-99ca-46b6-b9b8-836fe8eab30e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9e4b369-d1d9-4713-a8a4-27e41de2a89a", "name": "network-vif-unplugged", "status": "completed", "tag": "fb5785db-5a47-4d6c-a3a3-611049a4da85"}]} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:56:02.039091 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-2b193d39-a130-46d9-baec-a4239f78ec2c req-c12d843b-99ca-46b6-b9b8-836fe8eab30e service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:56:02.039858 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-2b193d39-a130-46d9-baec-a4239f78ec2c req-c12d843b-99ca-46b6-b9b8-836fe8eab30e service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:56:02.052894 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.compute.server_external_events [req-2b193d39-a130-46d9-baec-a4239f78ec2c req-c12d843b-99ca-46b6-b9b8-836fe8eab30e service nova] Creating event network-vif-unplugged:fb5785db-5a47-4d6c-a3a3-611049a4da85 for instance d9e4b369-d1d9-4713-a8a4-27e41de2a89a on hv-cinder-83563 May 19 21:56:02.070778 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [req-2b193d39-a130-46d9-baec-a4239f78ec2c req-c12d843b-99ca-46b6-b9b8-836fe8eab30e service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.105432 May 19 21:56:02.071558 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 569/1127] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 21:56:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 21:56:02.161317 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-1cf7ef99-24b2-47d3-8779-cfc72b9d00c7 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f69162209070421faef53c4f75803f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d49b95be55483f93b8a325d6bff693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:56:02.170141 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-1cf7ef99-24b2-47d3-8779-cfc72b9d00c7 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] 10.222.0.65 "GET /compute/v2.1/servers/d9e4b369-d1d9-4713-a8a4-27e41de2a89a" status: 200 len: 1575 microversion: 2.1 time: 0.164651 May 19 21:56:02.171050 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 559/1128] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:56:02 2022] GET /compute/v2.1/servers/d9e4b369-d1d9-4713-a8a4-27e41de2a89a => generated 1575 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:56:03.193761 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-08b51963-a81f-478c-8476-3a3dddef4b05 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:56:03.194365 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-08b51963-a81f-478c-8476-3a3dddef4b05 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] [instance: d9e4b369-d1d9-4713-a8a4-27e41de2a89a] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:56:03.201202 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-08b51963-a81f-478c-8476-3a3dddef4b05 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:56:03.201638 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-08b51963-a81f-478c-8476-3a3dddef4b05 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:56:03.202426 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-08b51963-a81f-478c-8476-3a3dddef4b05 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:56:03.202855 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-08b51963-a81f-478c-8476-3a3dddef4b05 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:56:03.341705 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-08b51963-a81f-478c-8476-3a3dddef4b05 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f69162209070421faef53c4f75803f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d49b95be55483f93b8a325d6bff693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:56:03.353315 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-08b51963-a81f-478c-8476-3a3dddef4b05 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] 10.222.0.65 "GET /compute/v2.1/servers/d9e4b369-d1d9-4713-a8a4-27e41de2a89a" status: 200 len: 1575 microversion: 2.1 time: 0.166964 May 19 21:56:03.354066 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 570/1129] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:56:03 2022] GET /compute/v2.1/servers/d9e4b369-d1d9-4713-a8a4-27e41de2a89a => generated 1575 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:56:04.371602 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-eec96d9c-2d3e-4530-8076-c5d1d45c3c8a tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:56:04.372239 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-eec96d9c-2d3e-4530-8076-c5d1d45c3c8a tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] [instance: d9e4b369-d1d9-4713-a8a4-27e41de2a89a] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:56:04.379508 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-eec96d9c-2d3e-4530-8076-c5d1d45c3c8a tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:56:04.380060 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-eec96d9c-2d3e-4530-8076-c5d1d45c3c8a tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:56:04.381339 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-eec96d9c-2d3e-4530-8076-c5d1d45c3c8a tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:56:04.381772 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-eec96d9c-2d3e-4530-8076-c5d1d45c3c8a tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:56:04.788287 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-eec96d9c-2d3e-4530-8076-c5d1d45c3c8a tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f69162209070421faef53c4f75803f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d49b95be55483f93b8a325d6bff693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:56:04.796246 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-eec96d9c-2d3e-4530-8076-c5d1d45c3c8a tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] 10.222.0.65 "GET /compute/v2.1/servers/d9e4b369-d1d9-4713-a8a4-27e41de2a89a" status: 200 len: 1575 microversion: 2.1 time: 0.428703 May 19 21:56:04.796830 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 560/1130] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:56:04 2022] GET /compute/v2.1/servers/d9e4b369-d1d9-4713-a8a4-27e41de2a89a => generated 1575 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:56:05.817488 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-bd34b2d0-fbe3-4584-9917-d8c2b25b780f tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:56:05.818155 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-bd34b2d0-fbe3-4584-9917-d8c2b25b780f tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] [instance: d9e4b369-d1d9-4713-a8a4-27e41de2a89a] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:56:05.825345 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-bd34b2d0-fbe3-4584-9917-d8c2b25b780f tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:56:05.825796 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-bd34b2d0-fbe3-4584-9917-d8c2b25b780f tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:56:05.826591 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-bd34b2d0-fbe3-4584-9917-d8c2b25b780f tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:56:05.827014 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-bd34b2d0-fbe3-4584-9917-d8c2b25b780f tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:56:05.976318 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-bd34b2d0-fbe3-4584-9917-d8c2b25b780f tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f69162209070421faef53c4f75803f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d49b95be55483f93b8a325d6bff693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:56:05.986903 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-bd34b2d0-fbe3-4584-9917-d8c2b25b780f tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] 10.222.0.65 "GET /compute/v2.1/servers/d9e4b369-d1d9-4713-a8a4-27e41de2a89a" status: 200 len: 1575 microversion: 2.1 time: 0.175822 May 19 21:56:05.987665 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 571/1131] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:56:05 2022] GET /compute/v2.1/servers/d9e4b369-d1d9-4713-a8a4-27e41de2a89a => generated 1575 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:56:07.014374 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-9fe5fcec-b784-433b-b610-b0fe8668606f tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:56:07.015258 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-9fe5fcec-b784-433b-b610-b0fe8668606f tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] [instance: d9e4b369-d1d9-4713-a8a4-27e41de2a89a] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:56:07.024653 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-9fe5fcec-b784-433b-b610-b0fe8668606f tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:56:07.025098 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-9fe5fcec-b784-433b-b610-b0fe8668606f tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:56:07.025897 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-9fe5fcec-b784-433b-b610-b0fe8668606f tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:56:07.026409 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-9fe5fcec-b784-433b-b610-b0fe8668606f tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:56:07.169022 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-9fe5fcec-b784-433b-b610-b0fe8668606f tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f69162209070421faef53c4f75803f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d49b95be55483f93b8a325d6bff693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:56:07.179715 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-9fe5fcec-b784-433b-b610-b0fe8668606f tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] 10.222.0.65 "GET /compute/v2.1/servers/d9e4b369-d1d9-4713-a8a4-27e41de2a89a" status: 200 len: 1575 microversion: 2.1 time: 0.172284 May 19 21:56:07.180287 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 561/1132] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:56:07 2022] GET /compute/v2.1/servers/d9e4b369-d1d9-4713-a8a4-27e41de2a89a => generated 1575 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:56:08.198422 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-f6a73711-07bc-4293-b4d4-a97c453fcce3 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:56:08.199113 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-f6a73711-07bc-4293-b4d4-a97c453fcce3 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] [instance: d9e4b369-d1d9-4713-a8a4-27e41de2a89a] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:56:08.207610 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f6a73711-07bc-4293-b4d4-a97c453fcce3 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:56:08.208158 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f6a73711-07bc-4293-b4d4-a97c453fcce3 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:56:08.209200 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f6a73711-07bc-4293-b4d4-a97c453fcce3 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:56:08.209698 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-f6a73711-07bc-4293-b4d4-a97c453fcce3 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:56:08.360789 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-f6a73711-07bc-4293-b4d4-a97c453fcce3 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f69162209070421faef53c4f75803f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d49b95be55483f93b8a325d6bff693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:56:08.372092 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-f6a73711-07bc-4293-b4d4-a97c453fcce3 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] 10.222.0.65 "GET /compute/v2.1/servers/d9e4b369-d1d9-4713-a8a4-27e41de2a89a" status: 200 len: 1575 microversion: 2.1 time: 0.178000 May 19 21:56:08.372833 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 572/1133] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:56:08 2022] GET /compute/v2.1/servers/d9e4b369-d1d9-4713-a8a4-27e41de2a89a => generated 1575 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:56:09.389930 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-f9d4bed4-7b9d-4188-b229-e5f12236e601 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:56:09.390544 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-f9d4bed4-7b9d-4188-b229-e5f12236e601 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] [instance: d9e4b369-d1d9-4713-a8a4-27e41de2a89a] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:56:09.398086 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f9d4bed4-7b9d-4188-b229-e5f12236e601 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:56:09.398797 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f9d4bed4-7b9d-4188-b229-e5f12236e601 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:56:09.399822 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f9d4bed4-7b9d-4188-b229-e5f12236e601 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:56:09.400422 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-f9d4bed4-7b9d-4188-b229-e5f12236e601 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:56:09.551159 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-f9d4bed4-7b9d-4188-b229-e5f12236e601 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f69162209070421faef53c4f75803f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d49b95be55483f93b8a325d6bff693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:56:09.559111 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-f9d4bed4-7b9d-4188-b229-e5f12236e601 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] 10.222.0.65 "GET /compute/v2.1/servers/d9e4b369-d1d9-4713-a8a4-27e41de2a89a" status: 200 len: 1562 microversion: 2.1 time: 0.173209 May 19 21:56:09.559681 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 562/1134] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:56:09 2022] GET /compute/v2.1/servers/d9e4b369-d1d9-4713-a8a4-27e41de2a89a => generated 1562 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:56:12.112952 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [req-ed423307-435b-462e-9fb0-f38f0f819e3a req-48e60c62-5e6e-42a6-9f46-aa184c4e34b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9e4b369-d1d9-4713-a8a4-27e41de2a89a", "name": "network-vif-plugged", "status": "completed", "tag": "fb5785db-5a47-4d6c-a3a3-611049a4da85"}]} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:56:12.121917 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-ed423307-435b-462e-9fb0-f38f0f819e3a req-48e60c62-5e6e-42a6-9f46-aa184c4e34b5 service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:56:12.122361 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-ed423307-435b-462e-9fb0-f38f0f819e3a req-48e60c62-5e6e-42a6-9f46-aa184c4e34b5 service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:56:12.133980 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.compute.server_external_events [req-ed423307-435b-462e-9fb0-f38f0f819e3a req-48e60c62-5e6e-42a6-9f46-aa184c4e34b5 service nova] Creating event network-vif-plugged:fb5785db-5a47-4d6c-a3a3-611049a4da85 for instance d9e4b369-d1d9-4713-a8a4-27e41de2a89a on hv-cinder-83563 May 19 21:56:12.139139 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [req-ed423307-435b-462e-9fb0-f38f0f819e3a req-48e60c62-5e6e-42a6-9f46-aa184c4e34b5 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029966 May 19 21:56:12.139729 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 573/1135] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 21:56:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 21:57:45.466271 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_api:SELECT=26 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:57:45.467069 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG dbcounter [-] [124349] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124349) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:57:45.469780 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_api:SELECT=28 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:57:45.470761 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG dbcounter [-] [124350] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 21:57:45.472578 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-211125b1-50a8-4068-950a-87ff480cda7d tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:57:45.473120 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-211125b1-50a8-4068-950a-87ff480cda7d tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] [instance: d9e4b369-d1d9-4713-a8a4-27e41de2a89a] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:57:45.491235 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-211125b1-50a8-4068-950a-87ff480cda7d tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:57:45.491680 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-211125b1-50a8-4068-950a-87ff480cda7d tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:57:45.492433 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-211125b1-50a8-4068-950a-87ff480cda7d tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:57:45.493282 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-211125b1-50a8-4068-950a-87ff480cda7d tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:57:45.519728 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-211125b1-50a8-4068-950a-87ff480cda7d tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] [instance: d9e4b369-d1d9-4713-a8a4-27e41de2a89a] Going to try to terminate instance {{(pid=124349) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 21:57:45.563955 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [req-8b3479a7-e83c-4801-bf1b-06ddaaf45c89 req-a29359e1-7080-43a1-8b86-c2427bf39ef2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9e4b369-d1d9-4713-a8a4-27e41de2a89a", "tag": "fb5785db-5a47-4d6c-a3a3-611049a4da85"}]} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:57:45.572738 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-8b3479a7-e83c-4801-bf1b-06ddaaf45c89 req-a29359e1-7080-43a1-8b86-c2427bf39ef2 service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:57:45.572956 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-8b3479a7-e83c-4801-bf1b-06ddaaf45c89 req-a29359e1-7080-43a1-8b86-c2427bf39ef2 service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:57:45.585624 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.compute.server_external_events [req-8b3479a7-e83c-4801-bf1b-06ddaaf45c89 req-a29359e1-7080-43a1-8b86-c2427bf39ef2 service nova] Creating event network-changed:fb5785db-5a47-4d6c-a3a3-611049a4da85 for instance d9e4b369-d1d9-4713-a8a4-27e41de2a89a on hv-cinder-83563 May 19 21:57:45.592222 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [req-8b3479a7-e83c-4801-bf1b-06ddaaf45c89 req-a29359e1-7080-43a1-8b86-c2427bf39ef2 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124956 May 19 21:57:45.592818 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 574/1136] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 21:57:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 21:57:45.612827 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-211125b1-50a8-4068-950a-87ff480cda7d tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] 10.222.0.65 "DELETE /compute/v2.1/servers/d9e4b369-d1d9-4713-a8a4-27e41de2a89a" status: 204 len: 0 microversion: 2.1 time: 0.148534 May 19 21:57:45.613437 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 563/1137] 10.222.0.65 () {58 vars in 1238 bytes} [Thu May 19 21:57:45 2022] DELETE /compute/v2.1/servers/d9e4b369-d1d9-4713-a8a4-27e41de2a89a => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 21:57:45.623039 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-5738046a-17e3-4ffc-b73e-f12a24db753e tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:57:45.623727 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-5738046a-17e3-4ffc-b73e-f12a24db753e tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] [instance: d9e4b369-d1d9-4713-a8a4-27e41de2a89a] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:57:45.630064 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5738046a-17e3-4ffc-b73e-f12a24db753e tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:57:45.630537 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5738046a-17e3-4ffc-b73e-f12a24db753e tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:57:45.631299 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5738046a-17e3-4ffc-b73e-f12a24db753e tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:57:45.631724 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-5738046a-17e3-4ffc-b73e-f12a24db753e tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:57:45.767101 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.policy [None req-5738046a-17e3-4ffc-b73e-f12a24db753e tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f69162209070421faef53c4f75803f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d49b95be55483f93b8a325d6bff693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124350) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:57:45.774765 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-5738046a-17e3-4ffc-b73e-f12a24db753e tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] 10.222.0.65 "GET /compute/v2.1/servers/d9e4b369-d1d9-4713-a8a4-27e41de2a89a" status: 200 len: 1568 microversion: 2.1 time: 0.156306 May 19 21:57:45.775332 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 575/1138] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:57:45 2022] GET /compute/v2.1/servers/d9e4b369-d1d9-4713-a8a4-27e41de2a89a => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:57:46.793412 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-0dd89ebb-fd8d-4fe6-b15f-7bff4780bfc2 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:57:46.794122 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-0dd89ebb-fd8d-4fe6-b15f-7bff4780bfc2 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] [instance: d9e4b369-d1d9-4713-a8a4-27e41de2a89a] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:57:46.801304 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-0dd89ebb-fd8d-4fe6-b15f-7bff4780bfc2 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:57:46.801745 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-0dd89ebb-fd8d-4fe6-b15f-7bff4780bfc2 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:57:46.802542 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-0dd89ebb-fd8d-4fe6-b15f-7bff4780bfc2 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:57:46.802976 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-0dd89ebb-fd8d-4fe6-b15f-7bff4780bfc2 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:57:46.971121 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-0dd89ebb-fd8d-4fe6-b15f-7bff4780bfc2 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f69162209070421faef53c4f75803f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d49b95be55483f93b8a325d6bff693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:57:46.979989 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-0dd89ebb-fd8d-4fe6-b15f-7bff4780bfc2 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] 10.222.0.65 "GET /compute/v2.1/servers/d9e4b369-d1d9-4713-a8a4-27e41de2a89a" status: 200 len: 1568 microversion: 2.1 time: 0.190773 May 19 21:57:46.980728 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 564/1139] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:57:46 2022] GET /compute/v2.1/servers/d9e4b369-d1d9-4713-a8a4-27e41de2a89a => generated 1568 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:57:47.983517 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [req-0713eeb0-ba62-4402-b44e-705af222a684 req-19577815-2ba8-4b2e-a489-a7cfaab59b90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9e4b369-d1d9-4713-a8a4-27e41de2a89a", "name": "network-vif-deleted", "tag": "fb5785db-5a47-4d6c-a3a3-611049a4da85"}]} {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 21:57:47.991645 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-0713eeb0-ba62-4402-b44e-705af222a684 req-19577815-2ba8-4b2e-a489-a7cfaab59b90 service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:57:47.992071 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [req-0713eeb0-ba62-4402-b44e-705af222a684 req-19577815-2ba8-4b2e-a489-a7cfaab59b90 service nova] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:57:47.997526 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-8125ed02-1955-47a4-8c8a-c4d6b3ba6e30 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Calling method '>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:57:47.998162 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.compute.api [None req-8125ed02-1955-47a4-8c8a-c4d6b3ba6e30 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] [instance: d9e4b369-d1d9-4713-a8a4-27e41de2a89a] Fetching instance by UUID {{(pid=124349) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:57:48.003359 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.compute.server_external_events [req-0713eeb0-ba62-4402-b44e-705af222a684 req-19577815-2ba8-4b2e-a489-a7cfaab59b90 service nova] Creating event network-vif-deleted:fb5785db-5a47-4d6c-a3a3-611049a4da85 for instance d9e4b369-d1d9-4713-a8a4-27e41de2a89a on hv-cinder-83563 May 19 21:57:48.004731 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-8125ed02-1955-47a4-8c8a-c4d6b3ba6e30 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:57:48.005234 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-8125ed02-1955-47a4-8c8a-c4d6b3ba6e30 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:57:48.006005 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-8125ed02-1955-47a4-8c8a-c4d6b3ba6e30 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:57:48.006476 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG oslo_concurrency.lockutils [None req-8125ed02-1955-47a4-8c8a-c4d6b3ba6e30 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124349) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:57:48.008297 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [req-0713eeb0-ba62-4402-b44e-705af222a684 req-19577815-2ba8-4b2e-a489-a7cfaab59b90 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085877 May 19 21:57:48.009087 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 576/1140] 10.222.0.65 () {64 vars in 1317 bytes} [Thu May 19 21:57:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 21:57:48.070938 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.policy [None req-8125ed02-1955-47a4-8c8a-c4d6b3ba6e30 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f69162209070421faef53c4f75803f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d49b95be55483f93b8a325d6bff693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124349) authorize /opt/stack/nova/nova/policy.py:199}} May 19 21:57:48.083892 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-8125ed02-1955-47a4-8c8a-c4d6b3ba6e30 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] 10.222.0.65 "GET /compute/v2.1/servers/d9e4b369-d1d9-4713-a8a4-27e41de2a89a" status: 200 len: 1220 microversion: 2.1 time: 0.090471 May 19 21:57:48.084708 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 565/1141] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:57:47 2022] GET /compute/v2.1/servers/d9e4b369-d1d9-4713-a8a4-27e41de2a89a => generated 1220 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 21:57:49.108539 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-99d14707-ec31-4242-a104-2a2b4e433279 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Calling method '>' {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:57:49.109563 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.compute.api [None req-99d14707-ec31-4242-a104-2a2b4e433279 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] [instance: d9e4b369-d1d9-4713-a8a4-27e41de2a89a] Fetching instance by UUID {{(pid=124350) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 21:57:49.120116 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-99d14707-ec31-4242-a104-2a2b4e433279 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:57:49.120837 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-99d14707-ec31-4242-a104-2a2b4e433279 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:57:49.122654 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-99d14707-ec31-4242-a104-2a2b4e433279 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 21:57:49.123097 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG oslo_concurrency.lockutils [None req-99d14707-ec31-4242-a104-2a2b4e433279 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Lock "77cb089b-88b9-45a8-a0a5-397a51f9efce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 21:57:49.136722 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.wsgi [None req-99d14707-ec31-4242-a104-2a2b4e433279 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] HTTP exception thrown: Instance d9e4b369-d1d9-4713-a8a4-27e41de2a89a could not be found. May 19 21:57:49.138768 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-99d14707-ec31-4242-a104-2a2b4e433279 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Request method failure captured: May 19 21:57:49.138768 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: request: GET /compute/v2.1/servers/d9e4b369-d1d9-4713-a8a4-27e41de2a89a HTTP/1.1 May 19 21:57:49.138768 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Accept: application/json May 19 21:57:49.138768 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Accept-Encoding: identity May 19 21:57:49.138768 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Connection: close May 19 21:57:49.138768 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Content-Length: 0 May 19 21:57:49.138768 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Content-Type: application/json May 19 21:57:49.138768 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Host: 10.222.0.65 May 19 21:57:49.138768 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Openstack-System-Scope: None May 19 21:57:49.138768 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: User-Agent: python-urllib3/1.26.9 May 19 21:57:49.138768 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Auth-Token: gAAAAABihrwurmrUlAX7Z2rwLLpITVkInRsJ6e1n30eFKoiR1u3VcyMGNR_MxPogC7xpcIFsgSfKdKjQ-cO6kmrMW3bekI4yezHW0h_WsumCWViVaef5LtB8zSMwf-LlRQB86ahgt5I3K3dE3_5ApJ9LuN-bnP4MicWLwfvTlk2yFSWQQ52GA08 May 19 21:57:49.138768 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Domain-Id: None May 19 21:57:49.138768 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Domain-Name: None May 19 21:57:49.138768 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Identity-Status: Confirmed May 19 21:57:49.138768 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Is-Admin-Project: True May 19 21:57:49.138768 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Project-Domain-Id: default May 19 21:57:49.138768 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Project-Domain-Name: Default May 19 21:57:49.138768 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Project-Id: 52d49b95be55483f93b8a325d6bff693 May 19 21:57:49.138768 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Project-Name: tempest-TestShelveInstance-1736981384 May 19 21:57:49.138768 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Role: reader,member May 19 21:57:49.138768 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Roles: reader,member May 19 21:57:49.140608 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/52d49b95be55483f93b8a325d6bff693"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/52d49b95be55483f93b8a325d6bff693"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_52d49b95be55483f93b8a325d6bff693"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/52d49b95be55483f93b8a325d6bff693"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}] May 19 21:57:49.140608 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Tenant: tempest-TestShelveInstance-1736981384 May 19 21:57:49.140608 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Tenant-Id: 52d49b95be55483f93b8a325d6bff693 May 19 21:57:49.140608 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-Tenant-Name: tempest-TestShelveInstance-1736981384 May 19 21:57:49.140608 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-User: tempest-TestShelveInstance-1736981384-project May 19 21:57:49.140608 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-User-Domain-Id: default May 19 21:57:49.140608 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-User-Domain-Name: Default May 19 21:57:49.140608 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-User-Id: f69162209070421faef53c4f75803f38 May 19 21:57:49.140608 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: X-User-Name: tempest-TestShelveInstance-1736981384-project May 19 21:57:49.140608 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: method: > May 19 21:57:49.140608 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: exception: Instance d9e4b369-d1d9-4713-a8a4-27e41de2a89a could not be found. May 19 21:57:49.140608 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: action_args: {'id': 'd9e4b369-d1d9-4713-a8a4-27e41de2a89a'} May 19 21:57:49.141641 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: {{(pid=124350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 21:57:49.141641 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:57:49.141641 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 21:57:49.141641 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 21:57:49.141641 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 21:57:49.141641 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 21:57:49.141641 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 21:57:49.141641 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 21:57:49.141641 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 21:57:49.141641 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 21:57:49.141641 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9e4b369-d1d9-4713-a8a4-27e41de2a89a could not be found. May 19 21:57:49.141641 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi May 19 21:57:49.141641 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 21:57:49.141641 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi May 19 21:57:49.141641 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:57:49.141641 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 21:57:49.141641 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 21:57:49.141641 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 21:57:49.141641 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 21:57:49.141641 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 21:57:49.143339 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 21:57:49.143339 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 21:57:49.143339 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 21:57:49.143339 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 21:57:49.143339 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 21:57:49.143339 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 21:57:49.143339 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 21:57:49.143339 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9e4b369-d1d9-4713-a8a4-27e41de2a89a could not be found. May 19 21:57:49.143339 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi May 19 21:57:49.143339 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 21:57:49.143339 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi May 19 21:57:49.143339 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 21:57:49.143339 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 21:57:49.143339 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 21:57:49.143339 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 21:57:49.143339 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 21:57:49.143339 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9e4b369-d1d9-4713-a8a4-27e41de2a89a could not be found. May 19 21:57:49.143339 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: ERROR nova.api.openstack.wsgi May 19 21:57:49.144857 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: DEBUG nova.api.openstack.wsgi [None req-99d14707-ec31-4242-a104-2a2b4e433279 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Returning 404 to user: Instance d9e4b369-d1d9-4713-a8a4-27e41de2a89a could not be found. {{(pid=124350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 21:57:49.144857 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO nova.api.openstack.requestlog [None req-99d14707-ec31-4242-a104-2a2b4e433279 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] 10.222.0.65 "GET /compute/v2.1/servers/d9e4b369-d1d9-4713-a8a4-27e41de2a89a" status: 404 len: 111 microversion: 2.1 time: 0.039619 May 19 21:57:49.144857 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: [pid: 124350|app: 0|req: 577/1142] 10.222.0.65 () {58 vars in 1235 bytes} [Thu May 19 21:57:49 2022] GET /compute/v2.1/servers/d9e4b369-d1d9-4713-a8a4-27e41de2a89a => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 21:57:49.314877 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: DEBUG nova.api.openstack.wsgi [None req-1c949322-a1a4-4035-aaf6-1ae10b881074 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] Calling method '.version_select at 0x7fe36349fdc0>' {{(pid=124349) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 21:57:49.338625 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO nova.api.openstack.requestlog [None req-1c949322-a1a4-4035-aaf6-1ae10b881074 tempest-TestShelveInstance-1736981384 tempest-TestShelveInstance-1736981384-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2092241253" status: 202 len: 0 microversion: 2.1 time: 0.027500 May 19 21:57:49.339248 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: [pid: 124349|app: 0|req: 566/1143] 10.222.0.65 () {58 vars in 1253 bytes} [Thu May 19 21:57:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2092241253 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 21:58:53.397220 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 21:58:53.398162 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Thu May 19 21:58:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 19 21:59:03.662158 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 21:59:03.663291 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Thu May 19 21:59:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 19 21:59:09.293678 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 21:59:09.294585 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Thu May 19 21:59:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 19 22:00:46.885289 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 22:00:46.885925 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Thu May 19 22:00:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 19 22:00:56.797952 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 22:00:56.799127 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Thu May 19 22:00:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 19 22:02:13.411467 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 22:02:13.412753 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Thu May 19 22:02:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 19 22:02:23.676241 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 22:02:23.677217 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Thu May 19 22:02:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 19 22:02:29.307869 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 22:02:29.307869 dv-cinder-835635-2-iscsi devstack@n-api.service[124350]: Thu May 19 22:02:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 19 22:02:48.992770 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 22:02:48.993680 dv-cinder-835635-2-iscsi devstack@n-api.service[124349]: Thu May 19 22:02:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!